-- Logs begin at Tue 2022-08-30 00:10:46 UTC, end at Tue 2022-08-30 01:37:45 UTC. -- Aug 30 00:53:15.889350 dv-cinder-815146-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 00:53:15.897799 dv-cinder-815146-13-smb devstack@keystone.service[89107]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:53:15 2022] *** Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: nodename: dv-cinder-815146-13-smb Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: machine: x86_64 Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: clock source: unix Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: pcre jit disabled Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: detected number of CPU cores: 4 Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: current working directory: / Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: your processes number limit is 47680 Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: your memory page size is 4096 bytes Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: detected max file descriptor number: 2048 Aug 30 00:53:15.899884 dv-cinder-815146-13-smb devstack@keystone.service[89107]: lock engine: pthread robust mutexes Aug 30 00:53:15.900609 dv-cinder-815146-13-smb devstack@keystone.service[89107]: thunder lock: enabled Aug 30 00:53:15.900609 dv-cinder-815146-13-smb devstack@keystone.service[89107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 00:53:15.900609 dv-cinder-815146-13-smb devstack@keystone.service[89107]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:53:15.939402 dv-cinder-815146-13-smb devstack@keystone.service[89107]: Python main interpreter initialized at 0x5570355039c0 Aug 30 00:53:15.939402 dv-cinder-815146-13-smb devstack@keystone.service[89107]: python threads support enabled Aug 30 00:53:15.939402 dv-cinder-815146-13-smb devstack@keystone.service[89107]: your server socket listen backlog is limited to 100 connections Aug 30 00:53:15.939402 dv-cinder-815146-13-smb devstack@keystone.service[89107]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:53:15.939736 dv-cinder-815146-13-smb devstack@keystone.service[89107]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:53:15.939817 dv-cinder-815146-13-smb devstack@keystone.service[89107]: *** Operational MODE: preforking *** Aug 30 00:53:15.940091 dv-cinder-815146-13-smb devstack@keystone.service[89107]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:53:15.940091 dv-cinder-815146-13-smb devstack@keystone.service[89107]: spawned uWSGI master process (pid: 89107) Aug 30 00:53:15.940290 dv-cinder-815146-13-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 00:53:15.942608 dv-cinder-815146-13-smb devstack@keystone.service[89107]: spawned uWSGI worker 1 (pid: 89118, cores: 1) Aug 30 00:53:15.942608 dv-cinder-815146-13-smb devstack@keystone.service[89107]: spawned uWSGI worker 2 (pid: 89119, cores: 1) Aug 30 00:53:15.942608 dv-cinder-815146-13-smb devstack@keystone.service[89107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:53:20.326414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:53:20.326414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: from cryptography.utils import int_from_bytes Aug 30 00:53:20.327211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:53:20.327211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: from cryptography.utils import int_from_bytes Aug 30 00:53:20.327578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:53:20.327578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: from cryptography.utils import int_from_bytes Aug 30 00:53:20.328035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:53:20.328035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: from cryptography.utils import int_from_bytes Aug 30 00:53:20.379157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:53:20.379337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:53:20.379522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] command line args: [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:53:20.379787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:53:20.379965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ================================================================================ {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:53:20.380218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] admin_token = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.380591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] config_dir = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.380691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.380767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:53:20.380835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] config_source = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.380899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:53:20.380998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] debug = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.381116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] command line args: [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:53:20.381251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.381450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:53:20.381599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.381687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ================================================================================ {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:53:20.381756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.381817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] admin_token = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.381979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] config_dir = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] config_source = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] debug = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_config_append = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.382959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_dir = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_file = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] insecure_debug = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.383989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_config_append = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_dir = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_file = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.384913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.385941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.386937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] publish_errors = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.387933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] notification_format = cadf {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] standard_threads = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.388885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] publish_errors = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] use_journal = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] use_json = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] use_stderr = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.389847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] use_syslog = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] standard_threads = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.390493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] strict_password_check = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.390741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.390922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] use_eventlog = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.390998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.391146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] use_journal = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.391226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.391302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] use_json = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.391429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.391537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] use_stderr = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.391777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.391873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] use_syslog = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.391946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] watch_log_file = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:53:20.392130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392377 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.392959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.393934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.394909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.395879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396265 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.396956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.397051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.397212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.397290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.405907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.406990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.407978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.408957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.409956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.410975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.411995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.412961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.413885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.414965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.415048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.415166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.415830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.415973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.enabled = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.416917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.417011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.417079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.417146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.417205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.417263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.418959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.419077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.419153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.419269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.420674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.421965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.422093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.external = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.423915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.password = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] auth.token = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.424857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.external = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.mapped = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.425955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.password = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] auth.token = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.426965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] catalog.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.427960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.428874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.429005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.429129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.429251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.429251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.434503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.434611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.434611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.434817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.434893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.434893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.435973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.436878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.437993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.438796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.439963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.440880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.441949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.442973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.443921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.444906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.445959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.446116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.446196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.446349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.446457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.446944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.447868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.448912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.password = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.449993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.450991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451676 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.451975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] role.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] role.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.452840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.453846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.454971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.455932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.456924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.457926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.458929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] policy.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.459834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] receipt.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.460956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.461039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.461198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.461277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.461441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.461520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.463939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] revoke.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] role.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] role.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] role.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.464967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] role.list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.465908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.connection = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.466904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.467903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.468867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.469953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.470084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.470177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:53:20.470345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.470604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.470851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.471090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.471328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.471565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.471821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.472084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.472337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.472585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.472826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.473089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.473334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.473578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.473831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.provider = fernet {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.474076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.474340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.474597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.474841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.475092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.475341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.475595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] trust.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.475838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.476084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.476325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.476575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.476860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.477137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.477389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.477686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.478583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.connection = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.478841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.479097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.479345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.479595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.479838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.480082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.480326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.480650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.480875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.481146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.481401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.481646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.481897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.482140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.482398 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.482636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.482881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.483355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:53:20.483455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=89119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:53:20.500116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.500385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.500574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.508634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.508876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.509183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.509402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.518468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.539101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.539330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.546146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.546381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.594477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.595559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.655647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.655887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.655983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.656232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.815447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.815447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.815447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.815818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.815897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.816048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.818643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.818885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.819114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.819342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.820585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.820585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.847134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.847295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.847524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.847752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.847973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.848870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.849303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.849403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.860547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.860820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.874938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.875030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.875159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.875246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.875376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.875459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=89118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:53:20.892230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.892378 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.892462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:53:20.892537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:53:20.892776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.892860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.893000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:53:20.893086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:53:20.893280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.893363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.893548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.893630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.893813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.894076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.894159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.894347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.903894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.908930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.909048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.909115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.909189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.909262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.909335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.909425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.911728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.911865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.914623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.914820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.914917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.915115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.915770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.916845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.917936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.918019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.918298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.918601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.941573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.942494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.943036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.943324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.943970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.944262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.948121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.948407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.948699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.949200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.949491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.949781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.955215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.955506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.956206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.956501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.959480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.959778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.960068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.960357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.960627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.960711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.961048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.961259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.961555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.961840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.962176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.962452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.962740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.962874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.963176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.963470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.979453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.979728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.980740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.981055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.983566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.984921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.986662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.986959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.988259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.988562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.991250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.992814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.995862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.996630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:20.998193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.998500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.998790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.999111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.999448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.999840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:20.999923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.000203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.000508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.001076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.001177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.001451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.015892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.016182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.016487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.016731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.017579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.018885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.018885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.018885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.023490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.025755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.025899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.027300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.027459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.027581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.029030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.029316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.030257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.030550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.030841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.031127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.031418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.031965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.032257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.032664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.032981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.033281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.043333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.047564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.047564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.047564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.047564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.047863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.047942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.048132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.061421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.062591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.064727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.065846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.067637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.068728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.069122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.070217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.070619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.070907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.071203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.071913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.072253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.072561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.078319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.079158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.081883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.082080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.082695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.082997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.083289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.083572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.083734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.084033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.084325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.084608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.092103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.092394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.092677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.093156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.093453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.093740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.099699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=89118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.099937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.100222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.100503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.100732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=89119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:53:21.100815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.101997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.102194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.102275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.102470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.102550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.102882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.103308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.103308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.103447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.103521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.103670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.103670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.104002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.104228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.104512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=89119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:53:21.138094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570355039c0 pid: 89118 (default app) Aug 30 00:53:21.139719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570355039c0 pid: 89119 (default app) Aug 30 00:53:21.141828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e39b1-87da-4339-8d02-28dbde095208 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:21.142123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e39b1-87da-4339-8d02-28dbde095208 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:21.142405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e39b1-87da-4339-8d02-28dbde095208 None None] PATH_INFO: `/v3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:21.146623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Tue Aug 30 00:53:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:28.652020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:28.652576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:28.652576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:28.658028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:53:28.663209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:28.663705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:28.663799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:28.734917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: INFO dbcounter [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] Registered counter for database keystone Aug 30 00:53:28.754660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG oslo_db.sqlalchemy.engines [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:53:28.761381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writer thread running {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:53:28.945700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG passlib.handlers.bcrypt [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=89118) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:53:28.946024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG passlib.handlers.bcrypt [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89118) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:53:29.004573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:29.006226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:29.136927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 00:53:29.581076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:29.651093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: INFO dbcounter [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] Registered counter for database keystone Aug 30 00:53:29.672658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG oslo_db.sqlalchemy.engines [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:53:29.678864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writer thread running {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:53:29.798907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d54b5-d2a5-4eab-8b74-15d37c6e45a6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:29.803132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:29.803771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:29.804057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:29.804338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:29.812724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:29.864358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:53:29.864698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83e877-4587-41bf-8b17-76054e2decd7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:29.874296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 30 00:53:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:53:29.880375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:29.895495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11dc39-11f1-4da3-aed5-7e52659cc844 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:29.900635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:29.901766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:29.902058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:29.902341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] PATH_INFO: `/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:29.903930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e7dff46aac1450a9c4f3cfcc96d1d48)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:29.956989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:53:29.957342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aab6c-32ab-4fab-b6ed-b86e754ccbd0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:29.962589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Aug 30 00:53:29 2022] GET /identity/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:31.854221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a453728-947f-4c84-b0f6-d2a68011fc18 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:31.854786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a453728-947f-4c84-b0f6-d2a68011fc18 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:31.854786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a453728-947f-4c84-b0f6-d2a68011fc18 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:31.858902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:31.864246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e200f-6b00-4d32-adea-03770176727a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:31.864687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e200f-6b00-4d32-adea-03770176727a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:31.864811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e200f-6b00-4d32-adea-03770176727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:31.886120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b90e200f-6b00-4d32-adea-03770176727a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:31.887665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b90e200f-6b00-4d32-adea-03770176727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:31.895505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 00:53:32.170328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a453728-947f-4c84-b0f6-d2a68011fc18 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:32.183189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a453728-947f-4c84-b0f6-d2a68011fc18 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:32.187388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ad00-9bc6-4727-b48a-e511fac3c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:32.187988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ad00-9bc6-4727-b48a-e511fac3c0fa admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:32.188268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ad00-9bc6-4727-b48a-e511fac3c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:32.188541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ad00-9bc6-4727-b48a-e511fac3c0fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:32.196783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ad00-9bc6-4727-b48a-e511fac3c0fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:32.198287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ad00-9bc6-4727-b48a-e511fac3c0fa admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:32.206948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 30 00:53:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:53:32.213338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e200f-6b00-4d32-adea-03770176727a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:32.222418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e200f-6b00-4d32-adea-03770176727a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:32.226778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b925e-87ff-4bf9-a109-a7201b46ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:32.228029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b925e-87ff-4bf9-a109-a7201b46ff46 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:32.228703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b925e-87ff-4bf9-a109-a7201b46ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:32.229017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b925e-87ff-4bf9-a109-a7201b46ff46 admin admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:32.230342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b925e-87ff-4bf9-a109-a7201b46ff46 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:32.232216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b925e-87ff-4bf9-a109-a7201b46ff46 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:32.233762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Tue Aug 30 00:53:32 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:34.253852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd9af-0d63-4af5-9774-02dc1c9433f3 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:34.254395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd9af-0d63-4af5-9774-02dc1c9433f3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:34.254395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd9af-0d63-4af5-9774-02dc1c9433f3 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:34.255118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882a39-26e7-4483-8ffe-98d3d800ec10 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:34.255470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882a39-26e7-4483-8ffe-98d3d800ec10 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:34.255691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882a39-26e7-4483-8ffe-98d3d800ec10 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:34.255785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:34.257250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:53:34.261086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:34.261375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:34.261658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:34.262578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:34.262942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:34.263236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:34.281095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:34.282285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:34.303733 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG passlib.handlers.bcrypt [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=89119) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:53:34.304134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG passlib.handlers.bcrypt [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=89119) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:53:34.354710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:34.356396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:34.363082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:53:34.458263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:53:34.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:34.673532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:34.746428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:34.753857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84467a-3d1b-4399-865e-50267e7cc96e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:34.790615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:34.791250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:34.791542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:34.791835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:34.862030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ca057-cb97-43e7-84c9-4a796d2daadb None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:34.864972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:34.872007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:34.873567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:34.897222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:34.903571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:34.904690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:34.905010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:34.905306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:34.917396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:34.926404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:34.927383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:34.928180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:53:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:53:34.933984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:34.976750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:53:34.982537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:35.034512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeb49f-f01f-4bcf-a18f-7e9ce53b3d54 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:35.067779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:35.068313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:35.068613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:35.068870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:35.069568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:35.069869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:35.071964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:35.081801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1081e-2ef9-4a76-bd02-c24e672029b1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:35.083779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:35.089907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:35.106090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:35.116312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:35.117273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:35.118101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:35.118435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:35.118717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:35.128909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:35.130397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:53:35.149354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:35.150580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:53:35.151374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:53:35.151374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:35.151374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:53:35.151374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:53:35.156505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:35.197789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42e67b-0555-4856-b7da-2f2e7945e210 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:35.231829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:35.232543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:35.232754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:35.233066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:35.234576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:35.236055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:35.237694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:35 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:35.244132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:35.266757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbc818-6803-49a8-a654-9b7352f521e4 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:35.301700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:35.302314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:35.302599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:35.302874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:35.303520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:35.303827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:35.305252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:35.323863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:35.342065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:35.348984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92a0c8-f0d8-42e0-a78e-bf07309b8f0d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:35.391522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6bf51-f1fd-477a-acc4-2cd4bc910487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:35.397912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6bf51-f1fd-477a-acc4-2cd4bc910487 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:35.397912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6bf51-f1fd-477a-acc4-2cd4bc910487 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:35.397912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6bf51-f1fd-477a-acc4-2cd4bc910487 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:35.397912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6bf51-f1fd-477a-acc4-2cd4bc910487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:35.397912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6bf51-f1fd-477a-acc4-2cd4bc910487 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:35.397912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:35.405900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:35.446894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:35.522409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923892-3207-4c9a-ac80-28492e325d2d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:35.564328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:35.564989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:35.565283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:35.565568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:35.566323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.domain.id=default, user.id=eb6feed3b7e84d328882d1d64e2f0e6c) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:35.566634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:35.568124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a62aaa-598b-4820-9c32-75f31d2c8268 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:35.577530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 30 00:53:35 2022] GET /identity/v3/role_assignments?user.id=eb6feed3b7e84d328882d1d64e2f0e6c&scope.domain.id=default&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 233 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:38.129692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dca02-8d06-4fc2-bcd2-c570eb45650a None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.130224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dca02-8d06-4fc2-bcd2-c570eb45650a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.130297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dca02-8d06-4fc2-bcd2-c570eb45650a None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.131589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:38.137584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad6a1-86e0-4738-8e48-7a6eb0a602ba None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.137989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad6a1-86e0-4738-8e48-7a6eb0a602ba None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.138181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad6a1-86e0-4738-8e48-7a6eb0a602ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.166494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f0ad6a1-86e0-4738-8e48-7a6eb0a602ba None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:38.167758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f0ad6a1-86e0-4738-8e48-7a6eb0a602ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:38.252459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:38.290944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7da18c-05ec-422f-916b-a162ae06ca54 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.291483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7da18c-05ec-422f-916b-a162ae06ca54 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.291931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7da18c-05ec-422f-916b-a162ae06ca54 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.293448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:38.298904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5a571-fb2a-4dbc-b441-b666a1cda26c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.299205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5a571-fb2a-4dbc-b441-b666a1cda26c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.299497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5a571-fb2a-4dbc-b441-b666a1cda26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.325922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-25c5a571-fb2a-4dbc-b441-b666a1cda26c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:38.327130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-25c5a571-fb2a-4dbc-b441-b666a1cda26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:38.359743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:38.392566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158bbee-6beb-4a6a-8754-35422f4ee607 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.393213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158bbee-6beb-4a6a-8754-35422f4ee607 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.393712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158bbee-6beb-4a6a-8754-35422f4ee607 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.395231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:38.401453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa171c-f5d2-4617-b11f-5afcf387afed None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.402024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa171c-f5d2-4617-b11f-5afcf387afed None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.402516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa171c-f5d2-4617-b11f-5afcf387afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.418627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:38.446068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-50aa171c-f5d2-4617-b11f-5afcf387afed None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:38.447681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-50aa171c-f5d2-4617-b11f-5afcf387afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:38.547288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 00:53:38.677810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc20f9-3e06-4954-8554-10dba980f7b9 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.678099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc20f9-3e06-4954-8554-10dba980f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.678297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc20f9-3e06-4954-8554-10dba980f7b9 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.679649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:38.692338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:38.692633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:38.693039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:38.721803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc20f9-3e06-4954-8554-10dba980f7b9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:38.723408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:38.724683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:38.809814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:38.810652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:38.855992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:38.993719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc20f9-3e06-4954-8554-10dba980f7b9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.014786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c892f-bdbb-46d9-802d-558932f5fd26 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.037576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.038566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.039047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.039544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.061246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.063251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.086057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f20c8-f44a-4bd5-ade1-d67cc39136a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.087290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f20c8-f44a-4bd5-ade1-d67cc39136a3 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.088777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f20c8-f44a-4bd5-ade1-d67cc39136a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.089281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f20c8-f44a-4bd5-ade1-d67cc39136a3 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.090173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f20c8-f44a-4bd5-ade1-d67cc39136a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.093925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f20c8-f44a-4bd5-ade1-d67cc39136a3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:53:39.100294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:39.101166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:53:39.101959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:53:39.101959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:53:39.101959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:53:39.103839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:53:39.105242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:39.124520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:39.218005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5ea01-d2d9-4feb-9874-c6459a70707f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.256426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.257189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.257545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.257830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.273396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:39.278545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:39.279407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:53:39.280148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:39.280862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:39.326137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 16/32] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 30 00:53:38 2022] POST /identity/v3/roles => generated 219 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:39.327379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49f34-6642-412d-a201-6fd94610ccab None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.327669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49f34-6642-412d-a201-6fd94610ccab None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.327948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49f34-6642-412d-a201-6fd94610ccab None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.333559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:39.334555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49f34-6642-412d-a201-6fd94610ccab None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:39.371589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:39.420523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f5a6a-d619-4e48-971c-622b616f28c6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.460731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:39.464562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49f34-6642-412d-a201-6fd94610ccab None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.468899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.469576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.469859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.470136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.470800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:39.471107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.472682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.493913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:39.493913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:39.522851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f5d51-ed6c-4778-81b8-e9b88e9edabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.523488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5d51-ed6c-4778-81b8-e9b88e9edabc None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.523779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5d51-ed6c-4778-81b8-e9b88e9edabc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.524679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5d51-ed6c-4778-81b8-e9b88e9edabc None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.525440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5d51-ed6c-4778-81b8-e9b88e9edabc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.526988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5d51-ed6c-4778-81b8-e9b88e9edabc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.605437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 30 00:53:39 2022] POST /identity/v3/roles => generated 225 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:39.607203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4350a-4c46-4812-a6b5-c69f1574f3c3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.607626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4350a-4c46-4812-a6b5-c69f1574f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.607921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4350a-4c46-4812-a6b5-c69f1574f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.619403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6acabc-9d23-4473-bb6c-7a19a2a73692 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.630050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-bef4350a-4c46-4812-a6b5-c69f1574f3c3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:39.631708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-bef4350a-4c46-4812-a6b5-c69f1574f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:39.659593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:39.667631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.674412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.674412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.674412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.674412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:39.674412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.674412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.686572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 18/36] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:39.687515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:39.719494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 19/37] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:39.723286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2688-970e-4890-8bb3-02ced609a44a None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.723848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2688-970e-4890-8bb3-02ced609a44a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.724359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2688-970e-4890-8bb3-02ced609a44a None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.727695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 20/38] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:39.728803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2688-970e-4890-8bb3-02ced609a44a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:39.812457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358598-7dcd-495d-be80-0c896186b5a7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.824218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:39.860570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2688-970e-4890-8bb3-02ced609a44a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:39.861232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.861977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.862272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.862557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.863224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.864728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.900416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9c0c6-ad09-4995-95fe-4de7b45ede57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:39.901084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9c0c6-ad09-4995-95fe-4de7b45ede57 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.901389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9c0c6-ad09-4995-95fe-4de7b45ede57 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.901657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9c0c6-ad09-4995-95fe-4de7b45ede57 None admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.902801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9c0c6-ad09-4995-95fe-4de7b45ede57 None admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:39.904319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9c0c6-ad09-4995-95fe-4de7b45ede57 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:39.905972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 21/39] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:39 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:39.907148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:39.907445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:39.907728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:39.926468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:39.927706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:39.998027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 22/40] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:39.998946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:40.071623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 19/41] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:53:39 2022] POST /identity/v3/projects => generated 301 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:40.071623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:40.084307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:40.126157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cb655-d3c4-47e7-9cf4-3f1845978555 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:40.168192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:40.169672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:40.170056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:40.170473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:40.172147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:40.173909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:40.176038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 23/42] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:40.182004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:40.241226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:40.301429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecccb3-19c4-4107-8101-12ec86b76305 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:40.315698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94cc24-2251-4475-8ef5-fe9035e949d3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:40.339096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:40.339689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:40.339974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:40.340253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] PATH_INFO: `/v3/domains/default/users/eb6feed3b7e84d328882d1d64e2f0e6c/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:40.342209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eb6feed3b7e84d328882d1d64e2f0e6c, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:40.343657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:40.351249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:40.351866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:40.352226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:40.352500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:40.353203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:40.354708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:40.433230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:40.438016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1361 bytes} [Tue Aug 30 00:53:40 2022] PUT /identity/v3/domains/default/users/eb6feed3b7e84d328882d1d64e2f0e6c/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:53:40.439140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:40.452082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 20/44] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 30 00:53:40 2022] POST /identity/v3/roles => generated 223 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:40.571981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d073b-d1dc-4687-b805-064f0868cbfd None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:40.623063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f4aa-bb13-47e1-9272-0f85d541589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:40.624091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f4aa-bb13-47e1-9272-0f85d541589d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:40.624522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f4aa-bb13-47e1-9272-0f85d541589d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:40.624818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f4aa-bb13-47e1-9272-0f85d541589d None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:40.626383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f4aa-bb13-47e1-9272-0f85d541589d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:40.627857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f4aa-bb13-47e1-9272-0f85d541589d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:40.629493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 25/45] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:40.635478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:40.746961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeba52-98ab-4bbd-adba-605bc09f8a3b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:40.749373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:40.781433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d635a5-779d-44ad-b322-003632f1bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:40.782065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d635a5-779d-44ad-b322-003632f1bcdc None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:40.782350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d635a5-779d-44ad-b322-003632f1bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:40.782627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d635a5-779d-44ad-b322-003632f1bcdc None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:40.783295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d635a5-779d-44ad-b322-003632f1bcdc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:40.784763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d635a5-779d-44ad-b322-003632f1bcdc None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:40.896592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 21/46] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:53:40 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:53:42.355944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2a85-343a-4d0d-b682-12911707cec1 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:42.356462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2a85-343a-4d0d-b682-12911707cec1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:42.356563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf2a85-343a-4d0d-b682-12911707cec1 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:42.357863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 26/47] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:42.363243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb08d-a596-447b-8281-e1d67922a3aa None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:42.363657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb08d-a596-447b-8281-e1d67922a3aa None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:42.363810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb08d-a596-447b-8281-e1d67922a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:42.381806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6d7eb08d-a596-447b-8281-e1d67922a3aa None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:42.383844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6d7eb08d-a596-447b-8281-e1d67922a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:42.450948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:42.726241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf2a85-343a-4d0d-b682-12911707cec1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:42.793871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:42.833070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a006b-fa3f-4d31-9d58-5466ede3bd47 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:42.833363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a006b-fa3f-4d31-9d58-5466ede3bd47 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:42.833458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf2a85-343a-4d0d-b682-12911707cec1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:42.833651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a006b-fa3f-4d31-9d58-5466ede3bd47 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:42.835006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 23/49] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:53:42.840273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:42.840560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:42.840851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:42.862490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:42.863790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:42.868636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:42.869373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:42.869668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:42.869955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:42.881844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:42.887852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:42.888769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:42.889534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 27/50] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:42.894813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:42.934368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 24/51] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:42.997401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f481c7-c1c6-44a0-ace4-71349c7f4d23 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:43.022225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:43.030519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:43.032499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:43.032499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:43.032499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:43.032499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:43.032752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:43.034066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:43.042844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 28/52] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:43.048307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:43.067293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:43.150549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886e21a-9ef3-4b8c-a12c-dbdf89e1e6d9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:43.184382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:43.185129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:43.185421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:43.185705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:43.186844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:43.188314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:43.190368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 25/53] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:43 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:43.195757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:43.207222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:43.295117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:43.298043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12655a4-5901-4a49-939c-058989faf8ad None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:43.310399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e374bf-7dd0-45bd-8aef-36a60b251dfb None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:43.334789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:43.335427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:43.335713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:43.335996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:43.338051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:43.339518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:43.341129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 29/54] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:43.347026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:43.350166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:43.351646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:43.351986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:43.352271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:43.353460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:43.354928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:43.356489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 26/55] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:43.361807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:43.467834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a28a-8639-40b8-8659-4ce5b2d29b07 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:43.503034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fc674-ad3e-470b-b5e9-0ac1fa092a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:43.503646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc674-ad3e-470b-b5e9-0ac1fa092a80 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:43.503931 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc674-ad3e-470b-b5e9-0ac1fa092a80 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:43.504280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc674-ad3e-470b-b5e9-0ac1fa092a80 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:43.504860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fc674-ad3e-470b-b5e9-0ac1fa092a80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:43.506776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fc674-ad3e-470b-b5e9-0ac1fa092a80 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:43.512195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:43.561977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bace-a6ab-44a3-bd6c-b2c7c9b3c774 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:43.582111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 27/56] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 30 00:53:43 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:53:43.604348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:43.605016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:43.605307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:43.605592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:43.606359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.domain.id=default, user.id=eb6feed3b7e84d328882d1d64e2f0e6c) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:43.606680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:43.608203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f644f2e-2e61-44c0-ac16-627f394d554f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:43.617182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 30/57] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 30 00:53:43 2022] GET /identity/v3/role_assignments?user.id=eb6feed3b7e84d328882d1d64e2f0e6c&scope.domain.id=default&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 530 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:45.553261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050371b1-8933-4d17-b0da-09794db3276b None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:45.553804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050371b1-8933-4d17-b0da-09794db3276b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:45.553804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050371b1-8933-4d17-b0da-09794db3276b None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:45.555845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:45.561173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:45.561601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:45.561750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:45.580370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:45.581627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:45.648817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:45.917251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050371b1-8933-4d17-b0da-09794db3276b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:45.921101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:46.021382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050371b1-8933-4d17-b0da-09794db3276b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:46.055081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194996dd-5239-4dfd-a187-f5e45aa16f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:46.055774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194996dd-5239-4dfd-a187-f5e45aa16f4b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:46.056067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194996dd-5239-4dfd-a187-f5e45aa16f4b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:46.056354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194996dd-5239-4dfd-a187-f5e45aa16f4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:46.057510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194996dd-5239-4dfd-a187-f5e45aa16f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:46.058987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194996dd-5239-4dfd-a187-f5e45aa16f4b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:46.060568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:46.066440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:46.116523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:46.167120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d683-64a2-4581-9d06-a2a5c8bd0113 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:46.200772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc422a20-3b32-4cbe-b504-3b03420cad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:46.201351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc422a20-3b32-4cbe-b504-3b03420cad09 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:46.201641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc422a20-3b32-4cbe-b504-3b03420cad09 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:46.201924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc422a20-3b32-4cbe-b504-3b03420cad09 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:46.202581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc422a20-3b32-4cbe-b504-3b03420cad09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:46.204028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc422a20-3b32-4cbe-b504-3b03420cad09 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:46.334996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:53:46 2022] POST /identity/v3/users => generated 275 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:49.507319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8102f-ebc6-455c-8e9f-42e9c11961a5 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:49.507319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8102f-ebc6-455c-8e9f-42e9c11961a5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:49.507319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8102f-ebc6-455c-8e9f-42e9c11961a5 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:49.507319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:49.526278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207753b4-135c-4181-90a0-88cad0713d9f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:49.527125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207753b4-135c-4181-90a0-88cad0713d9f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:49.527622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207753b4-135c-4181-90a0-88cad0713d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:49.554226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-207753b4-135c-4181-90a0-88cad0713d9f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:49.555897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-207753b4-135c-4181-90a0-88cad0713d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:49.674726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:49.862758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250753d-faaf-4deb-99bf-5a468034eb6a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:49.863380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250753d-faaf-4deb-99bf-5a468034eb6a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:49.863859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250753d-faaf-4deb-99bf-5a468034eb6a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:49.865439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 31/64] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:49.878951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfdd9b-1da1-4c89-8481-182f154a9a88 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:49.879584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfdd9b-1da1-4c89-8481-182f154a9a88 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:49.880137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfdd9b-1da1-4c89-8481-182f154a9a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:49.908491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bbd9-e463-41ce-a22e-07862d142263 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:49.909289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bbd9-e463-41ce-a22e-07862d142263 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:49.909829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bbd9-e463-41ce-a22e-07862d142263 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:49.911841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 32/65] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:49.918705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:49.919476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:49.919962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:49.921760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-34cfdd9b-1da1-4c89-8481-182f154a9a88 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:49.923008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-34cfdd9b-1da1-4c89-8481-182f154a9a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:49.948701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:49.950257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:49.988326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:50.084482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:53:50.097870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:50.132475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.137057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:50.217502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1ca6-bd50-4b40-8ab0-5a7a89fb41b1 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.218015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1ca6-bd50-4b40-8ab0-5a7a89fb41b1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.218435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1ca6-bd50-4b40-8ab0-5a7a89fb41b1 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.220211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 35/68] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:50.231729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76407-054c-414a-b7c8-e7b4c3a25f87 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.232365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76407-054c-414a-b7c8-e7b4c3a25f87 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.232790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76407-054c-414a-b7c8-e7b4c3a25f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.266543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-28c76407-054c-414a-b7c8-e7b4c3a25f87 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:50.269991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-28c76407-054c-414a-b7c8-e7b4c3a25f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:50.316392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e3186-ceed-4ba4-9cd4-cccb6ab9cbea None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:50.357451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1f39-9f08-42cf-83f5-e17cc10ca181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:50.359079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1f39-9f08-42cf-83f5-e17cc10ca181 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.359651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1f39-9f08-42cf-83f5-e17cc10ca181 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.360191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1f39-9f08-42cf-83f5-e17cc10ca181 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.373991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e1f39-9f08-42cf-83f5-e17cc10ca181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-660e1f39-9f08-42cf-83f5-e17cc10ca181 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:50.379613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:50.380463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:50.381236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:53:50.384724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:53:50.391312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d8f1-29a8-4e7f-94b1-fd99c73500c0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.391714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d8f1-29a8-4e7f-94b1-fd99c73500c0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.392096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d8f1-29a8-4e7f-94b1-fd99c73500c0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.398454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 35/70] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:50.399418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d8f1-29a8-4e7f-94b1-fd99c73500c0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.423394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 36/71] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:53:50.428959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.428959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.428959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.452529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:50.453830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:50.492009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:50.550160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 37/72] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:50.551026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.552392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d8f1-29a8-4e7f-94b1-fd99c73500c0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:50.584531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:50.600221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:50.601236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.601528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.602354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.603925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:50.604567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:50.606198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:50.619564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:50.621046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.667897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcd37-13f0-4bec-aa8e-488843519ad3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:50.714628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:50.715905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.716513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.717168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.731579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:50.736621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:50.737481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:50.738212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:50.739506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.752181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e91c69-0705-4422-8086-af0253fd6996 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:50.784659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:50.797496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:50.798143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.798773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.798773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.810203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:50.815644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:50.816541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:53:50.818194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:50.823729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.841824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:50.856451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac820b-9212-4a84-a06d-fd0a4a9d1bda None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:50.890770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:50.891411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.891695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.891972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.907580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:50.909079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:50.910853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:50.911614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:50.929393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fcd6-dc8a-4efd-b4f0-da8d107102ea None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:50.963546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:50.964196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:50.964483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:50.964763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:50.965971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:50.967461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:50.969106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:50.969886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.021370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774f8b-613c-4dda-80c5-d491993c801b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.022972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.058384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.058994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.059285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.059563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.060226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:51.060532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.061962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.070055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:51.071134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.072163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa09b5-37e4-40de-b4cb-8a5e6f9d1c66 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.079873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.109352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.109970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.110284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.110562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.111225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:51.111538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.112985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.122158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:51.122800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.181768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ee03-678a-41da-8f9e-9076c21dd99c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.216432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.217194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.217478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.217762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.223564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bafaa-82a4-4c27-9e67-05ab9ecb52d2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.228376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:51.233635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:51.234470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:51.235209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:51.235821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.240565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.261011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.261629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.261919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.262267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.302068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.333092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.334587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.335523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbc947-1878-4c64-a82a-145142005363 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.369394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.370012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.370298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.370575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.371225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.372665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.436185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 40/81] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:53:51.437166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.454585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 42/82] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:53:51 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:51.455455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.458128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.565855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d653-4029-4c87-8da9-850079d40849 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.585162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb99e6b-c0ef-4121-a454-c54c8da2a1c0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.608174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.608831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.609156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.609442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.610721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.612199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.613493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.615742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:51.615742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.634621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.636089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.636089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.636089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.637487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.638961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.640560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 43/84] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:51.641377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.718857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.744494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b7608-d9e5-4097-99a3-3ee0097e1bb0 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.786683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f65e86-5b20-451f-ae61-da57b1526690 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.793179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.793813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.794111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.794397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.795089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:51.795403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.796880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.808548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 42/85] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:51.809433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.832288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.833025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.833368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.833659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.834835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:51.840991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:51.843106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 44/86] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:51.844158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:51.921058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.925709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b51526-44a6-4ada-baf7-9fb60cacabf4 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.966498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:51.967863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:51.968316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:51.969124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:51.983290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02a395-52c0-4994-845c-06bfe9610cb3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:51.989683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:52.033358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.034708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.035716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.036213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.063334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.065512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:52.126483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.128195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:52.193405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:52.207319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 43/87] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:53:52.213650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:52.254553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:53:52.256300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:52.272792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:52.346972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77500af6-0cf0-462a-b6d6-f2400c3ebaa7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:52.381229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72e0a7-2fe3-49ca-b6c9-e8b91235a794 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:52.394179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.395257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.396105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.396897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.398510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.400683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:52.403000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 44/89] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:52 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:52.404396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:52.419047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.419542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.419834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.420115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.420855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=ea84489dac76463baccf51829ef3a571) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:52.421204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.422816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:52.428877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:53:52 2022] GET /identity/v3/role_assignments?user.id=ea84489dac76463baccf51829ef3a571&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:52.429690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:52.460858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:52.605264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bc10-b754-4fbf-82d1-03e98a961856 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:52.613920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f27a0-2933-4d18-ad7e-0c41d90ed22b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:52.633266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:52.674039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.674239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.674764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.675062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.675349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.675845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.676373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.676483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.676967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.677994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:52.678655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.680530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:52 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:52.686911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:52.689378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:52.691623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:52 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:52.694463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:52.891448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b8638-0406-41a6-b428-6510943589a3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:52.900746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:52.919558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35b8b-6a49-450f-b24a-4d3eb1a649bc None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:52.954583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.955208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.955497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.955778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.986660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:52.987281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:52.987566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:52.987846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:52.988586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] RBAC: Adding query filter params (role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=ea84489dac76463baccf51829ef3a571) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:52.988900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:52.991390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:53.005640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:53:52 2022] GET /identity/v3/role_assignments?user.id=ea84489dac76463baccf51829ef3a571&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:53.007009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:53.062069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:53.104343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:53.105876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:53.222487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ffe29-2783-4723-81f2-b037330a8771 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:53.280765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:53.281440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:53.281730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:53.282014 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:53.282758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=eb6feed3b7e84d328882d1d64e2f0e6c) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:53.283072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:53.284567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:53.291899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 49/94] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:53:53 2022] GET /identity/v3/role_assignments?user.id=eb6feed3b7e84d328882d1d64e2f0e6c&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:53.317224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:53:53.323824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:53.359554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:53.466773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b4d0-c111-4ff0-9168-9c20a2fc12b0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:53.522601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a039-fc3f-4962-b3d5-1851e85f55bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:53.523265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a039-fc3f-4962-b3d5-1851e85f55bc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:53.524401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a039-fc3f-4962-b3d5-1851e85f55bc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:53.524828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a039-fc3f-4962-b3d5-1851e85f55bc None admin] PATH_INFO: `/v3/projects/94d84879dce346cbbe9749c3e8f623c6` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:53.526132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a039-fc3f-4962-b3d5-1851e85f55bc None admin] RBAC: Authorizing `identity:get_project(project_id=94d84879dce346cbbe9749c3e8f623c6)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:53.527664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a039-fc3f-4962-b3d5-1851e85f55bc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:53.529666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:53 2022] GET /identity/v3/projects/94d84879dce346cbbe9749c3e8f623c6 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:53.535583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:53.658040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:53.678346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f2d13-8e3d-447f-bb60-0c4d603ad9e3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:53.722796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:53.723418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:53.723705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:53.723985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:53.724724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=94d84879dce346cbbe9749c3e8f623c6, user.id=ea84489dac76463baccf51829ef3a571) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:53.725148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:53.727265 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2f429-241c-4298-b6a3-1521f7e2a9a5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:53.737600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 47/97] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:53:53 2022] GET /identity/v3/role_assignments?user.id=ea84489dac76463baccf51829ef3a571&scope.project.id=94d84879dce346cbbe9749c3e8f623c6&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:53.842516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976d05-716f-4776-aef1-4c1c4a576d1b None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:53.843397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976d05-716f-4776-aef1-4c1c4a576d1b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:53.843862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976d05-716f-4776-aef1-4c1c4a576d1b None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:53.845430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 51/98] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:53.854120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ae19-b36e-46dd-acdf-104a2ffb18be None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:53.854435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ae19-b36e-46dd-acdf-104a2ffb18be None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:53.854687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65ae19-b36e-46dd-acdf-104a2ffb18be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:53.878612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ab65ae19-b36e-46dd-acdf-104a2ffb18be None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:53.879846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ab65ae19-b36e-46dd-acdf-104a2ffb18be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:53.967208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:54.028268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db030b-5f82-482e-a6af-5d78525ad9eb None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:54.028585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db030b-5f82-482e-a6af-5d78525ad9eb None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:54.028834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db030b-5f82-482e-a6af-5d78525ad9eb None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:54.030346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 52/100] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:54.035469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:54.035765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:54.036044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:54.065965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:54.067166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:54.155667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 49/101] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:54.487487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db030b-5f82-482e-a6af-5d78525ad9eb None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:54.599381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:54.621469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db030b-5f82-482e-a6af-5d78525ad9eb None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:54.666294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:54.666950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:54.667242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:54.667526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:54.678805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:54.682383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:54.688191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:54.689494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:54.690294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 53/102] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:54.696390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:54.704977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:54.825384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458d510-60eb-400d-bc2b-889e9a634d7a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:54.885102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e49c7-d8b6-4a4a-b83a-4a7c189b3112 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:54.931593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:54.932281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:54.932573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:54.932859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:54.934146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:54.934472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:54.936195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:54.946678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 54/103] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:53:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:54.952586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:54.964875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:54.979933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:54.980810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:54.981262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:54.981681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:54.985628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:54.987256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:54.989022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 50/104] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:53:54.995309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:55.121048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177c8fb-a086-4a00-b4fa-907090a8bb84 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:55.142988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:55.174779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a0ee-dc7c-4257-b81a-39b314f111b6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:55.212824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578c25-977a-4f03-9df9-1288352bee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:55.213474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578c25-977a-4f03-9df9-1288352bee05 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:55.213758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578c25-977a-4f03-9df9-1288352bee05 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:55.214038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578c25-977a-4f03-9df9-1288352bee05 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:55.214288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:55.214885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578c25-977a-4f03-9df9-1288352bee05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:55.215028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:55.215298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:55.215586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] PATH_INFO: `/v3/users/4c2b1d300dfe4476862f55f0fb07f76b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:55.216355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578c25-977a-4f03-9df9-1288352bee05 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:55.265766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] RBAC: Authorizing `identity:get_user(user_id=4c2b1d300dfe4476862f55f0fb07f76b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:55.267383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:55.271644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 55/105] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:54 2022] GET /identity/v3/users/4c2b1d300dfe4476862f55f0fb07f76b => generated 289 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:55.278262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:55.365824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:55.392343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 51/106] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:53:54 2022] POST /identity/v3/projects => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:53:55.393608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47ecc-a51d-4961-abab-9c036a59fa91 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:55.393908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47ecc-a51d-4961-abab-9c036a59fa91 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:55.394199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b47ecc-a51d-4961-abab-9c036a59fa91 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:55.403112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 52/107] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:55.411694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:55.412065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:55.412402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:55.425587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b155-63fc-44da-8c8b-658aef250d78 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:55.446465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:55.447883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:55.484176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:55.485367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:55.485921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:55.486446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:55.584548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:55.585329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:55.587378 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:55.665559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:55.713767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 56/109] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:53:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:53:55.719525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:55.811093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:55.866744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb458-20d7-458b-973b-0e15c008d495 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:55.913819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:55.915028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:55.915315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:55.915775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:55.916766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:55.918261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:55.920000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 54/110] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:55 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:55.925843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:56.041735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cc785-7e5b-4045-9b1f-a5b02d4e08a0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:56.086418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:56.087480 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.088003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.088359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.089151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] RBAC: Adding query filter params (role.id=f425ddffe22342b9958e50274b62147c, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=4c2b1d300dfe4476862f55f0fb07f76b) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:56.089468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:56.090931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c16701-226f-4fd8-841f-cd91f350702a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:56.101252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 57/111] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:53:55 2022] GET /identity/v3/role_assignments?user.id=4c2b1d300dfe4476862f55f0fb07f76b&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=f425ddffe22342b9958e50274b62147c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:56.408726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:56.469341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae16a5-2529-4f0a-98b7-466dee61ecd2 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.469658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae16a5-2529-4f0a-98b7-466dee61ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.469917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae16a5-2529-4f0a-98b7-466dee61ecd2 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.471537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 58/112] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:56.479361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd376c-ea95-4ca0-96d4-ff31fd72faa5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.479647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd376c-ea95-4ca0-96d4-ff31fd72faa5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.479925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd376c-ea95-4ca0-96d4-ff31fd72faa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.512276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-51bd376c-ea95-4ca0-96d4-ff31fd72faa5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:56.518580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-51bd376c-ea95-4ca0-96d4-ff31fd72faa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:56.553905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:56.558656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c9985-b5ee-4aac-89b1-674f01a05c68 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:56.587285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:56.607524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43557-9f10-49e1-bf7d-f78d73a6f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:56.608245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43557-9f10-49e1-bf7d-f78d73a6f798 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.608539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43557-9f10-49e1-bf7d-f78d73a6f798 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.608822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43557-9f10-49e1-bf7d-f78d73a6f798 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.623341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43557-9f10-49e1-bf7d-f78d73a6f798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-4eb43557-9f10-49e1-bf7d-f78d73a6f798 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:56.631022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:56.631878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:56.633317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:53:56.638519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 55/113] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:56.640513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a28a-958f-4529-958f-1ff453d9ecfc None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.640814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a28a-958f-4529-958f-1ff453d9ecfc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.641141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a28a-958f-4529-958f-1ff453d9ecfc None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.643140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 56/114] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:56.644004 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c8e2-8e03-40a1-a4ae-3940d17487b0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.644289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c8e2-8e03-40a1-a4ae-3940d17487b0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.644566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c8e2-8e03-40a1-a4ae-3940d17487b0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.649208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 57/115] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:56.651383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:53:56.651960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c8e2-8e03-40a1-a4ae-3940d17487b0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:56.653932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291a82-3e0c-4a14-aaf8-8df25aee9d22 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.654407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291a82-3e0c-4a14-aaf8-8df25aee9d22 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.654697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291a82-3e0c-4a14-aaf8-8df25aee9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.690088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-47291a82-3e0c-4a14-aaf8-8df25aee9d22 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:56.691217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-47291a82-3e0c-4a14-aaf8-8df25aee9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:56.826581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 60/117] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:56.828175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.832958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.833530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.869292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c8e2-8e03-40a1-a4ae-3940d17487b0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:56.884439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:56.888516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:56.974681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:56.975229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:56.975521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:56.975808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:56.980162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:56.980162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:56.980162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:57.000163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:53:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:57.004379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 61/119] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:57.010782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.012280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.036098 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:57.122235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2a254-7b38-46e8-afca-b5f2b8413d60 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.135714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:57.158971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.159679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.159971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.160252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.172773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:57.178175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:57.179148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 62/120] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:53:57.180628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.210495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4c7cf-d414-4cea-92a6-598370bbdbd1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.248020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.248581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.248873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.249191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.250420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:57.251905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:57.253550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 59/121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:57.254334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.364739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f39c7-f628-4de0-a42a-908f9442a697 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.382707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:57.407283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.407807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:57.408016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.408235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.408510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.409233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:57.409550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:57.410953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:57.421893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:57.422834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.446319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1cf3-518e-4562-a6aa-42d6ec586f53 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.502557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.503245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.503534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.503815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.529095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:57.536336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:57.537235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:53:57.537990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:57.538566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 63/123] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:57.540005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.566833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0da8b-8c82-4a73-b74e-a7440ca0ec9f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.611865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.612828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.613156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.613713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.615026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:57.617110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:57.618851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 61/124] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:57.619715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.660009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6863c9-a5bb-4a89-a926-02c9553a529f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.674813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:57.700700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.701661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.702120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.702607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.711336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:57.714757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:57.719852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:57.727366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:57.729328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.751891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1c779-e87a-4468-8b75-36ac8c7fe637 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.808295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.808993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.809630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.809630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.812596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:57.814400 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:57.824071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:57.824958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:57.870225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec676ca-e554-4180-a736-6ab6b21bc8a1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:57.933117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:57.934209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:57.934690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:57.935165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:57.936958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:57.936958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:57.939825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:57.954918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:57.956328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.004457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3d2b-2146-4540-9c77-c8ed76400b25 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.029137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:58.066726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:58.079641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04651513-35e9-4420-89be-3c10720b035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.081303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04651513-35e9-4420-89be-3c10720b035e None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.082088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04651513-35e9-4420-89be-3c10720b035e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.083650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04651513-35e9-4420-89be-3c10720b035e None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/ea84489dac76463baccf51829ef3a571/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.088322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04651513-35e9-4420-89be-3c10720b035e None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd22d1d1cf247f9a75db22834d80afd, user_id=ea84489dac76463baccf51829ef3a571, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.091205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04651513-35e9-4420-89be-3c10720b035e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.123136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339514f3-8e94-48b5-a4e1-31a738a11f5a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.164822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.165522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.165808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.166091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.166969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:58.167283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.169795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.174022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 63/128] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:53:57 2022] PUT /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/ea84489dac76463baccf51829ef3a571/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:53:58.176111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04651513-35e9-4420-89be-3c10720b035e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.184813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 66/129] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:53:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:58.184813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.376318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2e70-92dd-49e6-9d65-f271cf83757f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.388209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04651513-35e9-4420-89be-3c10720b035e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.415215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:58.432764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.433452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.433746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.434029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.435308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.436764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.438707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 67/130] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:58 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:58.439782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.447436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe23e43-6c47-4669-92d8-8b57dad49476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.448614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23e43-6c47-4669-92d8-8b57dad49476 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.449182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23e43-6c47-4669-92d8-8b57dad49476 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.449730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23e43-6c47-4669-92d8-8b57dad49476 None admin] PATH_INFO: `/v3/projects/94d84879dce346cbbe9749c3e8f623c6` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.451792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23e43-6c47-4669-92d8-8b57dad49476 None admin] RBAC: Authorizing `identity:get_project(project_id=94d84879dce346cbbe9749c3e8f623c6)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.454382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23e43-6c47-4669-92d8-8b57dad49476 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.456783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:58 2022] GET /identity/v3/projects/94d84879dce346cbbe9749c3e8f623c6 => generated 312 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:58.458147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941315-2dc6-4d17-99d3-e3b6ce3e21be None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.458627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941315-2dc6-4d17-99d3-e3b6ce3e21be None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.459096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941315-2dc6-4d17-99d3-e3b6ce3e21be None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.460803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 65/132] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:58.466705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941315-2dc6-4d17-99d3-e3b6ce3e21be None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.537155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:58.569391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86c2b-0c14-4dca-a933-979a1889b2e5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.607878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.608607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.608899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.609257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.610442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.611972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.613627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 68/133] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:58 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:58.614422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.634780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941315-2dc6-4d17-99d3-e3b6ce3e21be None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.672974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5ff3-6804-4896-b25b-151adf5388a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.675957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5ff3-6804-4896-b25b-151adf5388a3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.675957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5ff3-6804-4896-b25b-151adf5388a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.675957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5ff3-6804-4896-b25b-151adf5388a3 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.677250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5ff3-6804-4896-b25b-151adf5388a3 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.679129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5ff3-6804-4896-b25b-151adf5388a3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.681664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 66/134] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:58 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:58.682837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.683201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.683490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.704542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:58.705888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:58.707381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:58.763323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37462e1-8f3b-4f7e-8f83-e250fca9fc6b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.799409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:58.800388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.816833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fe3e9-77d6-4fcc-8bee-5ea49540cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.817851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fe3e9-77d6-4fcc-8bee-5ea49540cb37 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.818314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fe3e9-77d6-4fcc-8bee-5ea49540cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.818936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fe3e9-77d6-4fcc-8bee-5ea49540cb37 None admin] PATH_INFO: `/v3/projects/94d84879dce346cbbe9749c3e8f623c6/users/ea84489dac76463baccf51829ef3a571/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.822287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fe3e9-77d6-4fcc-8bee-5ea49540cb37 None admin] RBAC: Authorizing `identity:create_grant(project_id=94d84879dce346cbbe9749c3e8f623c6, user_id=ea84489dac76463baccf51829ef3a571, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.823777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fe3e9-77d6-4fcc-8bee-5ea49540cb37 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.847276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:58.919569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5a3c-28c6-4433-85e8-52e086579ffa None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:58.940996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:53:58 2022] PUT /identity/v3/projects/94d84879dce346cbbe9749c3e8f623c6/users/ea84489dac76463baccf51829ef3a571/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:53:58.940996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c11c4-028b-43a2-9193-126c530ece52 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.940996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c11c4-028b-43a2-9193-126c530ece52 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.940996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c11c4-028b-43a2-9193-126c530ece52 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.940996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 70/137] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:53:58.940996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c11c4-028b-43a2-9193-126c530ece52 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:58.986272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f972ef-7319-4b33-afd1-dc8be230c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:58.987290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f972ef-7319-4b33-afd1-dc8be230c299 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:58.988437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f972ef-7319-4b33-afd1-dc8be230c299 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:58.988732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f972ef-7319-4b33-afd1-dc8be230c299 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:58.990310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f972ef-7319-4b33-afd1-dc8be230c299 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:58.996288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f972ef-7319-4b33-afd1-dc8be230c299 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:58.998770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 68/138] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:53:58 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:59.001348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.001851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.002177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.044484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:53:59.046249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:53:59.137811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c11c4-028b-43a2-9193-126c530ece52 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:59.156862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:53:59.160978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:59.168816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:59.188402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:59.189638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.189925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.190234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/eb6feed3b7e84d328882d1d64e2f0e6c/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.193098 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd22d1d1cf247f9a75db22834d80afd, user_id=eb6feed3b7e84d328882d1d64e2f0e6c, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:59.196201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:59.198274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:59.275124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94817e0-5921-4dbb-b10d-7453a601dba0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:59.280140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 71/140] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:53:58 2022] PUT /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/eb6feed3b7e84d328882d1d64e2f0e6c/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:53:59.281301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:59.320979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:59.320979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.320979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.320979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/ea84489dac76463baccf51829ef3a571/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.321389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd22d1d1cf247f9a75db22834d80afd, user_id=ea84489dac76463baccf51829ef3a571, role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:59.321389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:59.406648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 70/141] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:53:59 2022] PUT /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/ea84489dac76463baccf51829ef3a571/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:53:59.427257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786f85-2f20-4733-b89a-c6c1fc9b4de6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:59.467961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:59.469121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.469641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.470199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.471681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:59.473534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:59.475536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 72/142] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:53:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:59.481839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:59.515354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:59.582355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:59.647430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8a1f4-5df7-41dd-bd2a-8cf85db8fe1a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:59.690076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:59.691109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.691605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.691884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.700138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:59.709393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:53:59.714601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3b04-9c0f-4974-98df-0b0eb5ec63ef None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:53:59.718750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:53:59.720072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:53:59.721261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 73/143] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:53:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:53:59.725771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:53:59.781252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:59.782695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.783446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.784204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.785591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:59.788503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:59.872846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0b32-db93-46f7-91da-ac505cb1821b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:53:59.885082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:59.924525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 71/144] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:53:59 2022] POST /identity/v3/users => generated 283 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:53:59.932829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:53:59.933513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:53:59.933865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:53:59.934148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:53:59.934906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:53:59.935220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:53:59.936645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:53:59.952290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 74/145] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:53:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:53:59.958283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:00.083667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b788d-cb3f-4e96-8399-c5e9aff4b8d1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:00.124013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:00.124700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:00.125062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:00.125347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] PATH_INFO: `/v3/users/4c2b1d300dfe4476862f55f0fb07f76b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:00.126558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] RBAC: Authorizing `identity:get_user(user_id=4c2b1d300dfe4476862f55f0fb07f76b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:00.128061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:00.131134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 72/146] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:53:59 2022] GET /identity/v3/users/4c2b1d300dfe4476862f55f0fb07f76b => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:00.139656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:00.281879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de86a17-a4b0-4ccd-89ac-3a248a37e605 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:00.326623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974212-a22f-4b6f-845e-34b0ee2c183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:00.327284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974212-a22f-4b6f-845e-34b0ee2c183c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:00.327568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974212-a22f-4b6f-845e-34b0ee2c183c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:00.327846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974212-a22f-4b6f-845e-34b0ee2c183c None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:00.329034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974212-a22f-4b6f-845e-34b0ee2c183c None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:00.330581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974212-a22f-4b6f-845e-34b0ee2c183c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:00.332458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:00 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:00.338561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:00.361680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:00.462802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4099cbb-87d8-45b7-8eb7-dec21f37725c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:00.506035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978569f-f5ca-4ee3-8be0-eaecd529e0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:00.506716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978569f-f5ca-4ee3-8be0-eaecd529e0e4 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:00.506999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978569f-f5ca-4ee3-8be0-eaecd529e0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:00.507295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978569f-f5ca-4ee3-8be0-eaecd529e0e4 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/4c2b1d300dfe4476862f55f0fb07f76b/roles/f425ddffe22342b9958e50274b62147c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:00.510227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978569f-f5ca-4ee3-8be0-eaecd529e0e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd22d1d1cf247f9a75db22834d80afd, user_id=4c2b1d300dfe4476862f55f0fb07f76b, role_id=f425ddffe22342b9958e50274b62147c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:00.511720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978569f-f5ca-4ee3-8be0-eaecd529e0e4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:00.587756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 73/148] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:54:00 2022] PUT /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/users/4c2b1d300dfe4476862f55f0fb07f76b/roles/f425ddffe22342b9958e50274b62147c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:00.711986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93281b-58ac-4834-bad2-d38b79bb16ea None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:00.712400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93281b-58ac-4834-bad2-d38b79bb16ea None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:00.712895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93281b-58ac-4834-bad2-d38b79bb16ea None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:00.715415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 76/149] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:00.722171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:00.722660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:00.723139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:00.766429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:00.768414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:00.929096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 74/150] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:01.295721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93281b-58ac-4834-bad2-d38b79bb16ea None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:01.350236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:01.426673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93281b-58ac-4834-bad2-d38b79bb16ea None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:01.471942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:01.473004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:01.473492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:01.473993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:01.493557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:01.498931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:01.499786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:01.500537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:01.503235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 77/151] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:54:01.510106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:01.533450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:01.681743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1553-507f-4b95-b7c5-4c8be19b0632 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:01.750791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:01.751424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:01.751709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:01.751988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:01.752676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:01.753009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:01.754427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:01.769134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 75/152] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:01.775305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:01.945957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:01.952202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd62712-1ed8-4e2b-98f1-0d010751df56 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:01.995856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d8815-bb8a-4961-ad91-c02da5b5bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:01.996868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d8815-bb8a-4961-ad91-c02da5b5bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:01.997400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d8815-bb8a-4961-ad91-c02da5b5bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:01.997884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d8815-bb8a-4961-ad91-c02da5b5bbd5 None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:01.999278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d8815-bb8a-4961-ad91-c02da5b5bbd5 None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:02.000980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d8815-bb8a-4961-ad91-c02da5b5bbd5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:02.003116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 78/153] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:01 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:02.009647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:02.118444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:02.158856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6889f6d-8cfd-4e9d-a8b3-38db6138e58c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:02.206044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a14e77-2429-4840-ba0e-3d4824bdffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:02.206582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a14e77-2429-4840-ba0e-3d4824bdffd8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.206870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a14e77-2429-4840-ba0e-3d4824bdffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.207149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a14e77-2429-4840-ba0e-3d4824bdffd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.288512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a14e77-2429-4840-ba0e-3d4824bdffd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:02.291360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a14e77-2429-4840-ba0e-3d4824bdffd8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:02.347483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708fc70-7edd-4bc8-8659-9299304374ac None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.348432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708fc70-7edd-4bc8-8659-9299304374ac None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.348958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708fc70-7edd-4bc8-8659-9299304374ac None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.350560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 79/154] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:54:02.358695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb3f3-fd7d-42c5-8c13-24f7f521d97b None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.359301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb3f3-fd7d-42c5-8c13-24f7f521d97b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.359866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb3f3-fd7d-42c5-8c13-24f7f521d97b None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.361429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 80/155] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:02.368046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435678e-5064-440d-8c86-1d081f262cab None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.368706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435678e-5064-440d-8c86-1d081f262cab None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.369256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435678e-5064-440d-8c86-1d081f262cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.413844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6435678e-5064-440d-8c86-1d081f262cab None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:02.415598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6435678e-5064-440d-8c86-1d081f262cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:02.421002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:02.520156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 76/156] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:02.521304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e93c-50c1-4925-90ff-dcefdcd8e6cd None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.521594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e93c-50c1-4925-90ff-dcefdcd8e6cd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.521872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e93c-50c1-4925-90ff-dcefdcd8e6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.556353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3c40e93c-50c1-4925-90ff-dcefdcd8e6cd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:02.557607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c40e93c-50c1-4925-90ff-dcefdcd8e6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:02.604426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 81/157] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:02.605708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435678e-5064-440d-8c86-1d081f262cab None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:02.739560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 77/158] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:02.816672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:02.824416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435678e-5064-440d-8c86-1d081f262cab None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:02.853722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbec5-bcd2-49c2-88d0-ae055db025cf None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.854388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbec5-bcd2-49c2-88d0-ae055db025cf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.855125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbec5-bcd2-49c2-88d0-ae055db025cf None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.857031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 78/159] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:02.864079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.864667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.865186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.888962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:02.888962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:02.888962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:02.888962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:02.893675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:02.895178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:02.895864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:02.897268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:02.897395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 82/160] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:02 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:02.902989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.014117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 79/161] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:03.106863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fdb1-642e-4dc4-933b-2cba6c8dddc1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:03.119501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.152772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:03.153505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:03.153793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:03.154076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:03.154831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=ea84489dac76463baccf51829ef3a571) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:03.155143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:03.156729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:03.163495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 83/162] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:02 2022] GET /identity/v3/role_assignments?user.id=ea84489dac76463baccf51829ef3a571&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:03.179491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:03.275704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52e6f9-1da8-46cd-9ffa-2bfd14523142 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:03.323101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:03.323773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:03.324059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:03.324335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:03.343662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:03.348829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:03.349828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:03.350622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:54:03.356810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.394147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:03.484992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206bbe3-9c1e-47de-ab58-8f1efbc1fb74 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:03.505212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.549909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:03.550539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:03.550826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:03.551103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:03.551788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:03.552098 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:03.553553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:03.569153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:03.575612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.696568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:03.709132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2268d-bf69-47a6-b97d-a899201d2861 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:03.712718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:03.743720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d11cf-70bd-4d6e-a24c-dae5923b83cd None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:03.762271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:03.762921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:03.763209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:03.763502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:03.765680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:03.767387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:03.769468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 85/165] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:03 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:03.771436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.825287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:03.825935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:03.826209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:03.826665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:03.861924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:03.867207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:03.868092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:03.869160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:03.871845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 81/166] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:03.872866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:03.938738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a09b-d30f-4dd0-9e63-f1c3fa9c8652 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:04.001371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:04.002037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.002326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.002630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.021331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:04.026486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:04.027365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:04.028136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 86/167] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:04.028851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:04.062622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:04.123204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923435d9-e8bd-4147-a936-847f203e08e2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:04.163729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63420b9f-eb50-4257-8c25-b6bbab0baccc None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:04.218677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:04.219315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.219600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.219877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.220563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:04.220872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:04.222490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:04.226187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:04.226930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.227240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.227482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.231892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 87/168] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:04.242813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:04.276383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:04.406911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:04.408686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:04.435974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:04.502470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01cc8e-c200-4823-b4de-3113686a1904 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:04.558809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:04.559461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.559750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.560134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.560827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:04.561160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:04.562580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:04.580341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 88/169] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:04.582206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 82/170] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:04.585912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:04.588615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:04.670418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:04.755564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ccf5d-6b62-4cae-8468-885f09171664 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:04.774983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff55ddf-a77f-4c5b-a982-00c968657004 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:04.828572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:04.829174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.829463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.829743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] PATH_INFO: `/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.832151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] RBAC: Authorizing `identity:get_user(user_id=eb6feed3b7e84d328882d1d64e2f0e6c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:04.833661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:04.836480 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 89/171] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:04 2022] GET /identity/v3/users/eb6feed3b7e84d328882d1d64e2f0e6c => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:04.837993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:04.846394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93c6eb-def4-44a2-a7ae-9a79ef9bbd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:04.847301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c6eb-def4-44a2-a7ae-9a79ef9bbd5c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.847745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c6eb-def4-44a2-a7ae-9a79ef9bbd5c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.848186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c6eb-def4-44a2-a7ae-9a79ef9bbd5c None admin] PATH_INFO: `/v3/users/ea84489dac76463baccf51829ef3a571` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.849589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93c6eb-def4-44a2-a7ae-9a79ef9bbd5c None admin] RBAC: Authorizing `identity:get_user(user_id=ea84489dac76463baccf51829ef3a571)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:04.852305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93c6eb-def4-44a2-a7ae-9a79ef9bbd5c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:04.854386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:04.854683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 83/172] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:04 2022] GET /identity/v3/users/ea84489dac76463baccf51829ef3a571 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:04.860949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1be1f-080a-443a-b889-e7147aaacb85 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:04.866413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1be1f-080a-443a-b889-e7147aaacb85 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:04.866413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1be1f-080a-443a-b889-e7147aaacb85 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:04.866413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 84/173] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:04.866413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1be1f-080a-443a-b889-e7147aaacb85 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:04.963634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ea758-13eb-44ae-9e56-c6e38826bfea None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:05.003390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1be1f-080a-443a-b889-e7147aaacb85 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:05.009780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf50af7-9f34-4a86-91de-a0735ab88e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:05.010433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf50af7-9f34-4a86-91de-a0735ab88e9a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.010721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf50af7-9f34-4a86-91de-a0735ab88e9a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.011004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf50af7-9f34-4a86-91de-a0735ab88e9a None admin] PATH_INFO: `/v3/projects/94d84879dce346cbbe9749c3e8f623c6` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.012187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf50af7-9f34-4a86-91de-a0735ab88e9a None admin] RBAC: Authorizing `identity:get_project(project_id=94d84879dce346cbbe9749c3e8f623c6)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:05.013681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf50af7-9f34-4a86-91de-a0735ab88e9a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:05.020550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:04 2022] GET /identity/v3/projects/94d84879dce346cbbe9749c3e8f623c6 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:05.020550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67a56-0c29-4129-91b7-d37a00ada844 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.020550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67a56-0c29-4129-91b7-d37a00ada844 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.020550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a67a56-0c29-4129-91b7-d37a00ada844 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.020878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 91/175] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:05.021732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a67a56-0c29-4129-91b7-d37a00ada844 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:05.028091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:05.047727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f3a0-b81c-4cbc-95b2-28eb49cd8336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:05.048582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f3a0-b81c-4cbc-95b2-28eb49cd8336 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.049044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f3a0-b81c-4cbc-95b2-28eb49cd8336 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.049488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f3a0-b81c-4cbc-95b2-28eb49cd8336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.121514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:05.129679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f3a0-b81c-4cbc-95b2-28eb49cd8336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:05.131426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f3a0-b81c-4cbc-95b2-28eb49cd8336 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:05.153614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a67a56-0c29-4129-91b7-d37a00ada844 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:05.204430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae29a2-f464-4e1f-bed9-9e10572ab077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:05.205396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae29a2-f464-4e1f-bed9-9e10572ab077 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.205949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae29a2-f464-4e1f-bed9-9e10572ab077 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.206238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae29a2-f464-4e1f-bed9-9e10572ab077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.248778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 85/176] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:05.250107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84c564-4070-46ea-b93b-a8025b423287 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.250398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84c564-4070-46ea-b93b-a8025b423287 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.250674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84c564-4070-46ea-b93b-a8025b423287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.269033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6c84c564-4070-46ea-b93b-a8025b423287 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:05.270593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6c84c564-4070-46ea-b93b-a8025b423287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:05.286032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:05.287845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae29a2-f464-4e1f-bed9-9e10572ab077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:05.289984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae29a2-f464-4e1f-bed9-9e10572ab077 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:05.346168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 86/177] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:05.347422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894aac9-3185-46fb-b373-f5e4ac7ae5a0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.347710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894aac9-3185-46fb-b373-f5e4ac7ae5a0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.347986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894aac9-3185-46fb-b373-f5e4ac7ae5a0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.349407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 87/178] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:05.353982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894aac9-3185-46fb-b373-f5e4ac7ae5a0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:05.405825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:05.442978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 92/179] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:05.446251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.446897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.448110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.467351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:05.468590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:05.491594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894aac9-3185-46fb-b373-f5e4ac7ae5a0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:05.559028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:05.559660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.560008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.560293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.561150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=94d84879dce346cbbe9749c3e8f623c6, user.id=ea84489dac76463baccf51829ef3a571) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:05.561463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:05.562923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cbbe9-03d2-4dbd-97b2-fd062d5cda98 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:05.565901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 93/180] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:05.567171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:05.589473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 88/181] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:05 2022] GET /identity/v3/role_assignments?user.id=ea84489dac76463baccf51829ef3a571&scope.project.id=94d84879dce346cbbe9749c3e8f623c6&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:05.589473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac258c-12e7-45e6-a132-edc6aea04bc8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.589473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac258c-12e7-45e6-a132-edc6aea04bc8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.589473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac258c-12e7-45e6-a132-edc6aea04bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.627159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-72ac258c-12e7-45e6-a132-edc6aea04bc8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:05.628388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-72ac258c-12e7-45e6-a132-edc6aea04bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:05.644123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:05.725047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 89/182] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:05.727318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7523-93a0-4e4b-87d9-1f529bfd437c None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.727655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7523-93a0-4e4b-87d9-1f529bfd437c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.727934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7523-93a0-4e4b-87d9-1f529bfd437c None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.729433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 90/183] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:05.730192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7523-93a0-4e4b-87d9-1f529bfd437c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:05.739700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c466a44-7561-482c-aa6a-ffb4c590ca97 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:05.754428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:05.821472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:05.822727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.823207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.823535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.825457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:05.828314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:05.830834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 94/184] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:05 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:05.831661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:05.873715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7523-93a0-4e4b-87d9-1f529bfd437c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:05.922685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677d41-4c3b-4f05-aa27-29b04c6ffb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:05.923821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677d41-4c3b-4f05-aa27-29b04c6ffb5b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.924112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677d41-4c3b-4f05-aa27-29b04c6ffb5b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.924392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677d41-4c3b-4f05-aa27-29b04c6ffb5b None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.925898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50677d41-4c3b-4f05-aa27-29b04c6ffb5b None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:05.928032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50677d41-4c3b-4f05-aa27-29b04c6ffb5b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:05.930528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 91/185] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:05 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:05.932037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:05.932507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:05.932798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:05.953026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:05.954242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:05.957376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.028482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268612-6f10-4dec-9ec3-a9d682a5d452 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.032682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 92/186] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:06.033343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.081888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.082523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.082806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.083080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.096438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:06.101846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:06.102718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:06.103506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:06.104956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 95/187] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:06.104956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.141968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.150101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914888d-19ca-4d7e-bdae-879d977deeb4 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.194664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.195436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.195709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.195984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.196717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=eb6feed3b7e84d328882d1d64e2f0e6c) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:06.197054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.198731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.205995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 93/188] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/role_assignments?user.id=eb6feed3b7e84d328882d1d64e2f0e6c&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.205995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.210384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.222686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff159-0819-4d85-834d-b266fa91de09 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.279597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.280305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.280649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.281036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.297110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:06.302978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:06.303958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:06.307054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 96/189] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:06.307992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.355737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9a64-acba-4b32-b436-bcc447b3f09e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.398506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.399454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.399739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.400019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.400768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] RBAC: Adding query filter params (role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=ea84489dac76463baccf51829ef3a571) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:06.401153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.402637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.411049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/role_assignments?user.id=ea84489dac76463baccf51829ef3a571&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.412192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.449661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.458510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601b68-d053-42ed-ab94-baec539b3c32 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.505426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.506488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.506984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.507546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.519144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.523977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:06.529271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:06.531210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:06.532236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:06.535309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 97/191] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:06.536510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.572437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b2d49-7738-455e-ba0c-2774b0afaac9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.627293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.627928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.628209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.628987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.631349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:06.631349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.631349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.643580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.644575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.693983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98472-347e-49e8-bcdb-df909b5039e6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.732690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.733458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.733850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.734214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.734982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:06.735379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.737175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.754941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.754941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.772502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4a50b-ef23-451d-a469-0a1b996e8c2f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.788019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.809780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:06.816403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.817531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.817531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.817683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.818852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.820896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.822749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.823366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.879758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a8d9-466d-41d4-9d13-769229a93e58 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.924655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.925374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.925660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.925942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.926661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:06.926960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.928065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b2d17-f81f-41e6-a6b2-d2b5d6c43d79 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:06.928515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.936643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 99/195] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.937491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:06.968566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:06.969253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:06.969539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:06.969824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] PATH_INFO: `/v3/users/4c2b1d300dfe4476862f55f0fb07f76b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:06.971007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] RBAC: Authorizing `identity:get_user(user_id=4c2b1d300dfe4476862f55f0fb07f76b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:06.972451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:06.975057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 97/196] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/users/4c2b1d300dfe4476862f55f0fb07f76b => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:06.975057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.020918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.041255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51243-07f9-4356-9746-7cb6f5c1e722 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.044777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.084366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.085062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.085347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.086294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] PATH_INFO: `/v3/users/182f0f6452a64a0d9912686b6c527f41` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.086792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5cdd-d302-4790-94b2-edf4e2de4f69 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.099730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] RBAC: Authorizing `identity:get_user(user_id=182f0f6452a64a0d9912686b6c527f41)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.101270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.103056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 100/197] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:06 2022] GET /identity/v3/users/182f0f6452a64a0d9912686b6c527f41 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:07.103833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.124420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.125113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.125405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.125694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.126360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.127823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.210431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dee8c-c0c0-4d1c-b1f8-f9d40fa8187a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.214490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 98/198] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:06 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:07.233113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.249658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.250318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.250600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.256657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] PATH_INFO: `/v3/users/182f0f6452a64a0d9912686b6c527f41` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.256657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] RBAC: Authorizing `identity:get_user(user_id=182f0f6452a64a0d9912686b6c527f41)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.256657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.256657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 101/199] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:07 2022] GET /identity/v3/users/182f0f6452a64a0d9912686b6c527f41 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:07.256657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.267338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.347382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816950f0-a844-4b1a-afde-d3b5f5038f0a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.373645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.384324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103964-98d7-41d6-9cc0-6c18b73f50a1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.391541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.392600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.393812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.393812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.431096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.431724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.432063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.439727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.480095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.482788 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.541594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.543391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.553225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.652117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 99/200] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:07.654327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.682204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 102/201] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:07.683087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.713351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.814192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3bb5-abda-4115-a2f9-4668ce07b921 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.823165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c1aa-a01f-442c-b3f8-f5e9d0062c71 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:07.833843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:07.866241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.867352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.867839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.868309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.873371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:07.877741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:07.878593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:07.878882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:07.880152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.882249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.885097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 103/202] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:07 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:07.885992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:07.953490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:07.955296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:07.990940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:08.013813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9db6-9963-41a6-91f3-e1ace174a458 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:08.068463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:08.069683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:08.070920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:08.071439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:08.072852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:08.074554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:08.076486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 104/203] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:07 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:08.077551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:08.112416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 100/204] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:08.113668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:08.136843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:08.219510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678148-899f-4601-9d4b-9ee603b26634 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:08.228533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc415-b83d-49a1-84dc-6ca7892eb674 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:08.255227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:08.267107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:08.268025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:08.268327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:08.268680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:08.269948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] RBAC: Adding query filter params (role.id=f425ddffe22342b9958e50274b62147c, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd, user.id=4c2b1d300dfe4476862f55f0fb07f76b) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:08.270275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:08.271763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:08.271978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:08.272772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:08.273803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:08.274280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:08.275276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=182f0f6452a64a0d9912686b6c527f41) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:08.275909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:08.277621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:08.281084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 105/205] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:08 2022] GET /identity/v3/role_assignments?user.id=4c2b1d300dfe4476862f55f0fb07f76b&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=f425ddffe22342b9958e50274b62147c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:08.282194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:08.292891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 101/206] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:08 2022] GET /identity/v3/role_assignments?user.id=182f0f6452a64a0d9912686b6c527f41&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:08.420180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13029a-f5c9-4faf-8d6a-cb71585573c6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:08.433029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:08.487251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3380-4d36-4295-940d-12893f9795ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:08.488360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3380-4d36-4295-940d-12893f9795ea None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:08.488857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3380-4d36-4295-940d-12893f9795ea None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:08.489386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3380-4d36-4295-940d-12893f9795ea None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:08.490946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc3380-4d36-4295-940d-12893f9795ea None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:08.493529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc3380-4d36-4295-940d-12893f9795ea None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:08.495926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 106/207] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:08 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:08.502575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:08.648396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d9024-3e82-47b6-98a1-f61d455b7c65 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:08.684237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:08.684880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:08.685185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:08.685464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:08.686215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] RBAC: Adding query filter params (role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=182f0f6452a64a0d9912686b6c527f41) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:08.686521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:08.688031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940da0dd-fa4f-4e16-978e-57074558188f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:08.695514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 102/208] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:08 2022] GET /identity/v3/role_assignments?user.id=182f0f6452a64a0d9912686b6c527f41&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:09.425933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8433-afeb-4958-9a71-002d0e5fbb9b None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:09.426486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8433-afeb-4958-9a71-002d0e5fbb9b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:09.426486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8433-afeb-4958-9a71-002d0e5fbb9b None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:09.428088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 107/209] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:09.434363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038c47-444e-4df1-befc-467d72e40c11 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:09.434791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038c47-444e-4df1-befc-467d72e40c11 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:09.434974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038c47-444e-4df1-befc-467d72e40c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:09.455181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c3038c47-444e-4df1-befc-467d72e40c11 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:09.456366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c3038c47-444e-4df1-befc-467d72e40c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:09.509977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:09.538935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 103/210] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:09.656030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3b46-56c1-4d56-a3e1-7128504c99f2 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:09.656320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3b46-56c1-4d56-a3e1-7128504c99f2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:09.656604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3b46-56c1-4d56-a3e1-7128504c99f2 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:09.657989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 108/211] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:09.663248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:09.663570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:09.664564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:09.683945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:09.685093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:09.760840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 104/212] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:09.831053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3b46-56c1-4d56-a3e1-7128504c99f2 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:09.977208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3b46-56c1-4d56-a3e1-7128504c99f2 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:10.014238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:10.014936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.015225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.015557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.026919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:10.031474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:10.032419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:10.033320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:10.034164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:10.037032 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 109/213] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:10.042007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:10.089109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.144264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00993d-d734-40d5-85de-09721ba6e840 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:10.156026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.173027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4e6f-f2fa-4048-b8c1-585e941a63a4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:10.192253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:10.193172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.193463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.193753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.195294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:10.196776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:10.200930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 105/214] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:10.206163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:10.225258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:10.225900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.226257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.226558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.227413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:10.227623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:10.229049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:10.243964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:10.246460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:10.326073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb568-069f-4f7f-8b24-4cbaba77c95c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:10.370785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f9936-8716-465d-9b0d-7e82ac7d14a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:10.372371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9936-8716-465d-9b0d-7e82ac7d14a9 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.372809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9936-8716-465d-9b0d-7e82ac7d14a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.373518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f9936-8716-465d-9b0d-7e82ac7d14a9 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.374605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f9936-8716-465d-9b0d-7e82ac7d14a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:10.375985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.378089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f9936-8716-465d-9b0d-7e82ac7d14a9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:10.382087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2955-f223-44c3-9134-12080c7521ba None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:10.422432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:10.423168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.423522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.423872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] PATH_INFO: `/v3/users/d61fcfc144004d3bb299cbfe779e9466` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.442292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] RBAC: Authorizing `identity:get_user(user_id=d61fcfc144004d3bb299cbfe779e9466)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:10.443819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:10.446615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 111/216] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:10 2022] GET /identity/v3/users/d61fcfc144004d3bb299cbfe779e9466 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:10.452353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:10.477108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 106/217] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:10 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:54:10.494803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f58322-e332-4684-b341-36066f8db0f9 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.495858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f58322-e332-4684-b341-36066f8db0f9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.496834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f58322-e332-4684-b341-36066f8db0f9 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.498881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 107/218] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:54:10.504558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca10e8-f419-4a8a-b402-cb4a9fd22eaf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.512228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca10e8-f419-4a8a-b402-cb4a9fd22eaf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.512228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca10e8-f419-4a8a-b402-cb4a9fd22eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.544100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-33ca10e8-f419-4a8a-b402-cb4a9fd22eaf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:10.546940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-33ca10e8-f419-4a8a-b402-cb4a9fd22eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:10.589436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66f446-f40f-4b40-8263-959b78d12e9d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:10.590994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.630144 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:10.630991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.631367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.631745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.652808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 108/219] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:10.664322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.719250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:10.720793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:10.830601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053ead4-6b8b-472f-bdc7-3141f485a1b5 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.830945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053ead4-6b8b-472f-bdc7-3141f485a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.831159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053ead4-6b8b-472f-bdc7-3141f485a1b5 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.832526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 109/220] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:10.838179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:10.838479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:10.838841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:10.845841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 112/221] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:10.851711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:10.868080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:10.869877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:10.933375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:10.970888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 110/222] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:10.972628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.015171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6552-522a-4f8f-b6ae-2140f9dee223 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.067109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.067758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.068043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.068324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.069929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:11.072893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:11.080103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:10 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:11.081471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.128484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:11.142202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5facc-7c47-4f2a-9779-7a58b79ceb04 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.218091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.219835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.221093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.221450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.242565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:11.248252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:11.249352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:11.250315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:11.252182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:11.256898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.299960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28590a9-9666-4bc1-a52d-c3c886ef0c06 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.326911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:11.348238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.348238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.348238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.348238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.348987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=d61fcfc144004d3bb299cbfe779e9466) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:11.348987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:11.348987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:11.351660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 114/225] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/role_assignments?user.id=d61fcfc144004d3bb299cbfe779e9466&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:11.353289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.372127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfffb4-cee4-46bb-aad9-035875422641 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.431032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.432189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.432549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.432900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.433713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:11.434095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:11.436176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:11.449273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 112/226] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:11.455209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.477259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:11.497161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728822-9a7a-4935-beea-73e18f963482 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.534737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.535476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.536077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.536367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.549030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:11.555429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:11.556486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:11.557724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 115/227] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:11.562591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.620463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:11.645838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed04af-aafb-4698-8073-198f9755a7de None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.694682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27d216-aa44-4de1-9b52-3276fa4a35ce None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.733083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.733950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.734381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.734894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.735715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:11.736166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:11.737946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:11.742211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.742979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.743264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.743541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] PATH_INFO: `/v3/users/182f0f6452a64a0d9912686b6c527f41` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.744752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] RBAC: Authorizing `identity:get_user(user_id=182f0f6452a64a0d9912686b6c527f41)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:11.746250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:11.747850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 113/228] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/users/182f0f6452a64a0d9912686b6c527f41 => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:11.749076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 116/229] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:11.753503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.754714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:11.901305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8fcfd-760e-42d2-a3c7-f24fc8c29a16 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.911722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:11.921317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:11.934435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a990f-0a53-4399-991e-1e0903cddc99 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:11.940329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:11.941007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:11.941296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:11.941581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] PATH_INFO: `/v3/users/182f0f6452a64a0d9912686b6c527f41` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:11.942764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] RBAC: Authorizing `identity:get_user(user_id=182f0f6452a64a0d9912686b6c527f41)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:11.944225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:11.947443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 117/230] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/users/182f0f6452a64a0d9912686b6c527f41 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:11.952798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:12.004673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:12.005354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:12.005721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:12.006106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:12.008706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:12.010221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:12.014018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 114/231] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:12.020083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:12.163339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa20011-2a64-4cdd-ab78-28e884d9efa4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:12.203206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68908cde-4cce-4b8a-9d85-d21d9327cacc None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:12.235403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:12.235905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:12.235905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:12.236223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:12.239307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:12.240788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:12.242995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 118/232] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:11 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:12.249561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864158dc-92bc-47a0-8873-f002bcb025d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:12.249829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:12.250913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864158dc-92bc-47a0-8873-f002bcb025d9 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:12.251412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864158dc-92bc-47a0-8873-f002bcb025d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:12.251892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864158dc-92bc-47a0-8873-f002bcb025d9 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/182f0f6452a64a0d9912686b6c527f41/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:12.254497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864158dc-92bc-47a0-8873-f002bcb025d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c43a9da75a0f49fe9cb72bc94809f662, user_id=182f0f6452a64a0d9912686b6c527f41, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:12.256183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864158dc-92bc-47a0-8873-f002bcb025d9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:12.311312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:12.335344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 115/233] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:54:12 2022] PUT /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/182f0f6452a64a0d9912686b6c527f41/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:12.401142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a850-6a8e-4164-bfaa-7df12b09247e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:12.459135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266fb5f-9699-4425-9e17-41210110264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:12.459740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266fb5f-9699-4425-9e17-41210110264c None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:12.460027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266fb5f-9699-4425-9e17-41210110264c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:12.460336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266fb5f-9699-4425-9e17-41210110264c None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/182f0f6452a64a0d9912686b6c527f41/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:12.462801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266fb5f-9699-4425-9e17-41210110264c None admin] RBAC: Authorizing `identity:create_grant(project_id=c43a9da75a0f49fe9cb72bc94809f662, user_id=182f0f6452a64a0d9912686b6c527f41, role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:12.464293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266fb5f-9699-4425-9e17-41210110264c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:12.564432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:54:12 2022] PUT /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/182f0f6452a64a0d9912686b6c527f41/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:13.227070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f262d5-203d-4d1c-a471-a8c9765ff7da None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.227929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f262d5-203d-4d1c-a471-a8c9765ff7da None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.228360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f262d5-203d-4d1c-a471-a8c9765ff7da None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.229928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 116/235] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:13.235631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.236195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.236633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.258801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:13.260253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:13.319147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764478a-8a3a-4008-a653-7eb4f8782770 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.319733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764478a-8a3a-4008-a653-7eb4f8782770 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.320806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764478a-8a3a-4008-a653-7eb4f8782770 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.322319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 117/236] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:13.328129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c402-c52f-49d7-8b0f-50699a55c421 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.328449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c402-c52f-49d7-8b0f-50699a55c421 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.328736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c402-c52f-49d7-8b0f-50699a55c421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.359624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9781c402-c52f-49d7-8b0f-50699a55c421 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:13.360854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9781c402-c52f-49d7-8b0f-50699a55c421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:13.377310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:13.382967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 120/237] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:13.461924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 118/238] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:13.791879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:13.834805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:13.881704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91ddd-79b6-4aeb-8110-3babe6448f26 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.882249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91ddd-79b6-4aeb-8110-3babe6448f26 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.882355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91ddd-79b6-4aeb-8110-3babe6448f26 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.884709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 119/239] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:13.891384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.891682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.891967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.910874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:13.912098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:13.925898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3b47a-36d7-4e5c-b9d6-1bb68229257a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:13.972369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:13.973044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:13.973332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:13.973616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:13.984900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:13.989834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:13.990735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:13.991568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 121/240] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:13.992214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.006494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 120/241] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:14.007508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.101537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:14.137748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c746e4-25e8-4953-9a3a-1a63943bf5e8 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.150110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:14.156238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d6fb-c933-4c33-b4b4-a402e010284e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.176260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.176908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.177271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.177553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.178699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:14.180817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:14.182988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 122/242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:14.188486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.253711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.254406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.254630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.254908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.255600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] RBAC: Adding query filter params (name=reader) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:14.255907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:14.257930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:14.277282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 121/243] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:14.294016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.311254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98549eea-c5e5-40d2-8323-69d2fe13f9f5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.348915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.349589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.349982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.350257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.357031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:14.357031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:14.437737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9085-0846-46e5-8cf8-5747ab93aecd None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.458363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 123/244] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:14 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:54:14.459230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.483707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:14.490812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.493656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.494317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.494807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] PATH_INFO: `/v3/users/87133c29581649fda783622a28bda8ce` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.498340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:14.532689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] RBAC: Authorizing `identity:get_user(user_id=87133c29581649fda783622a28bda8ce)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:14.535223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:14.537230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 122/245] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:14 2022] GET /identity/v3/users/87133c29581649fda783622a28bda8ce => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:14.548032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.628135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3434-3836-40c6-8d6e-824e81adfb3d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.676612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.677303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.677593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.677865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.691746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:14.697473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:14.698376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:14.699464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:14.704259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 124/246] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:14.705640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:14.751801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3cd3-6356-4c10-a6af-ed23541efb9f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.797971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d250c8-e3a5-44d3-91f8-53151cd03817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.798987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d250c8-e3a5-44d3-91f8-53151cd03817 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.799953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d250c8-e3a5-44d3-91f8-53151cd03817 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.800441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d250c8-e3a5-44d3-91f8-53151cd03817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.809416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:14.846338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c765-3e8f-4b7a-b53c-4111958d2a26 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:14.886861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:14.893418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:14.894046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.894390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.894675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.895361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:14.895662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:14.897137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376bf74-d9dc-4425-8838-802b0b203ff7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:14.906080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d250c8-e3a5-44d3-91f8-53151cd03817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:14.907593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d250c8-e3a5-44d3-91f8-53151cd03817 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:14.913069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 125/247] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:14.915458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06e624-ce14-4b32-a5e2-54208467aada None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:14.915804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06e624-ce14-4b32-a5e2-54208467aada None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:14.916096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06e624-ce14-4b32-a5e2-54208467aada None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:14.917900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 126/248] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:14.919550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06e624-ce14-4b32-a5e2-54208467aada None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:15.044634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 123/249] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:15.046526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.046899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.047185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.065923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06e624-ce14-4b32-a5e2-54208467aada None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:15.066545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:15.067734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:15.106263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568ca2-f778-415d-8e69-5265c3149793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:15.106902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568ca2-f778-415d-8e69-5265c3149793 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.107185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568ca2-f778-415d-8e69-5265c3149793 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.107464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568ca2-f778-415d-8e69-5265c3149793 None admin] PATH_INFO: `/v3/users/d61fcfc144004d3bb299cbfe779e9466` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.108688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1568ca2-f778-415d-8e69-5265c3149793 None admin] RBAC: Authorizing `identity:get_user(user_id=d61fcfc144004d3bb299cbfe779e9466)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:15.110093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1568ca2-f778-415d-8e69-5265c3149793 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:15.112168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 127/250] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:14 2022] GET /identity/v3/users/d61fcfc144004d3bb299cbfe779e9466 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:15.113349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace199d-8d99-4ca9-8ec2-5f3d132d9e6d None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.113690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace199d-8d99-4ca9-8ec2-5f3d132d9e6d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.113972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace199d-8d99-4ca9-8ec2-5f3d132d9e6d None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.115194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 128/251] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:15.115956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace199d-8d99-4ca9-8ec2-5f3d132d9e6d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:15.139593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:15.157509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 124/252] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:15.165764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:15.205108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:15.256299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace199d-8d99-4ca9-8ec2-5f3d132d9e6d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:15.297858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3249d0-3e79-4a6e-be00-0c828835dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:15.299151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3249d0-3e79-4a6e-be00-0c828835dc61 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.299581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3249d0-3e79-4a6e-be00-0c828835dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.300000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3249d0-3e79-4a6e-be00-0c828835dc61 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.301328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3249d0-3e79-4a6e-be00-0c828835dc61 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:15.302994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3249d0-3e79-4a6e-be00-0c828835dc61 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:15.306938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 129/253] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:15 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:15.308308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.308747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.309186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.332377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:15.333828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:15.389367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba121a-dbb8-4984-a51e-a9f08940a2d5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:15.449689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 130/254] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:15.452794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:15.469303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:15.470220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.470641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.471056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.472413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:15.472824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:15.478295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:15.484141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 125/255] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:15 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:15.489260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:15.603861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a88a9-7805-4a38-9c0e-2d66de644216 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:15.621031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:15.633548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a78bb-8850-4784-bc03-b63d77689745 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:15.642305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:15.643100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.643522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.643942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.644998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] RBAC: Adding query filter params (role.id=f425ddffe22342b9958e50274b62147c, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=87133c29581649fda783622a28bda8ce) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:15.645489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:15.647110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:15.654132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 131/256] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:15 2022] GET /identity/v3/role_assignments?user.id=87133c29581649fda783622a28bda8ce&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=f425ddffe22342b9958e50274b62147c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:15.655347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:15.682887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:15.688575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.689529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.690005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/d61fcfc144004d3bb299cbfe779e9466/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.693791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] RBAC: Authorizing `identity:create_grant(project_id=c43a9da75a0f49fe9cb72bc94809f662, user_id=d61fcfc144004d3bb299cbfe779e9466, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:15.696929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:15.755167 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:15.775842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 126/257] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:54:15 2022] PUT /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/d61fcfc144004d3bb299cbfe779e9466/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:54:15.798829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec12f46-e6c7-4ed1-ba6f-daa21f8fc8bc None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:15.852444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:15.853959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:15.854521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:15.854988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:15.873182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:15.879312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:15.880262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:15.881108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:15.884530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 132/258] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:15.890416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.001597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.066910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5657d5-bf8c-4d7c-9902-e8f2ab235158 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:16.149708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:16.150569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:16.150975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:16.151375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:16.152178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:16.152648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:16.154230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:16.154812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284c2d-3bba-4af8-9567-9fdbeb337e5e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:16.173799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 127/259] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:16.180784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.209560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:16.214057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:16.222541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:16.223506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:16.223947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:16.224378 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:16.249877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:16.255123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:16.264665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 133/260] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:54:16.265578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.312130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca3cf-59b2-4888-843c-709a2c1d7a05 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:16.353714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:16.354346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:16.354638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:16.354922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] PATH_INFO: `/v3/users/182f0f6452a64a0d9912686b6c527f41` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:16.356096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] RBAC: Authorizing `identity:get_user(user_id=182f0f6452a64a0d9912686b6c527f41)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:16.360964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:16.360964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 128/261] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:16 2022] GET /identity/v3/users/182f0f6452a64a0d9912686b6c527f41 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:16.365346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.477734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6127f08-9324-4d72-bdbe-fa1a0a269f4b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:16.551796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:16.568098 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:16.568739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:16.570152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:16.570473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:16.571260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:16.571574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:16.576427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:16.593625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 134/262] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:16.599281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbdf74-7456-4db2-9589-ce30d57d23bd None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:16.612375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.681693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:16.682335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:16.682628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:16.682911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:16.714986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:16.774550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f974b0-78d9-4211-bcfa-44139d17fa09 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:16.842750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:16.843406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:16.843692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:16.843976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] PATH_INFO: `/v3/users/182f0f6452a64a0d9912686b6c527f41` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:16.849677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] RBAC: Authorizing `identity:get_user(user_id=182f0f6452a64a0d9912686b6c527f41)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:16.851703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:16.853705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 135/263] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:16 2022] GET /identity/v3/users/182f0f6452a64a0d9912686b6c527f41 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:16.858875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:16.871111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:16.872663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:17.036793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:17.065235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fb039-e1e5-43e5-ac18-d1249922d56f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:17.069525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 129/264] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:54:17.076384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:17.117866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:17.158656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:17.159205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.159486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.159761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.302664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:17.305362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:17.312646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec0e5-d4e3-44dd-b58b-efcbd5c186de None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:17.409773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:17.410360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.410657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.410943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.412168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:17.415246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:17.420975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 130/265] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:17 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:17.427814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:17.499663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 136/266] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:17.513279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:17.537093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:17.546726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:17.626186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d925b5-1074-49d8-bcb4-57cb4a89fe6a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:17.635223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f72f-021f-4212-8a6f-4fa3b5d4fd7b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:17.667514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:17.668656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.669531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.670242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.671650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=182f0f6452a64a0d9912686b6c527f41) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:17.672188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:17.674074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa78f1-7ff4-4e10-8763-fca75e2047e4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:17.674417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b9f0-d900-45de-9e9a-e9284558a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:17.675130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b9f0-d900-45de-9e9a-e9284558a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.675486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b9f0-d900-45de-9e9a-e9284558a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.675839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b9f0-d900-45de-9e9a-e9284558a4b5 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.677111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b9f0-d900-45de-9e9a-e9284558a4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:17.678836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b9f0-d900-45de-9e9a-e9284558a4b5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:17.680880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 137/267] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:17 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:17.682236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f769aa-93ee-4122-8110-05529499531d None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.682594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f769aa-93ee-4122-8110-05529499531d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.682946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f769aa-93ee-4122-8110-05529499531d None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.683965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 131/268] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:17 2022] GET /identity/v3/role_assignments?user.id=182f0f6452a64a0d9912686b6c527f41&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:17.685532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114555-8c1c-452a-9544-ce6d63519d43 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.686029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114555-8c1c-452a-9544-ce6d63519d43 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.686522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114555-8c1c-452a-9544-ce6d63519d43 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.687951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 132/269] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:17.689296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114555-8c1c-452a-9544-ce6d63519d43 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:17.689626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 138/270] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:17.696966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ff76-c1f3-49b9-aa7c-5cecbbd7c4f5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.696966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ff76-c1f3-49b9-aa7c-5cecbbd7c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.696966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ff76-c1f3-49b9-aa7c-5cecbbd7c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.719691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-33a3ff76-c1f3-49b9-aa7c-5cecbbd7c4f5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:17.720817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-33a3ff76-c1f3-49b9-aa7c-5cecbbd7c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:17.870543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 139/271] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:17.871922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.872191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.872470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.888092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114555-8c1c-452a-9544-ce6d63519d43 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:17.894392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:17.895577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:17.912781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:17.918396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:17.943013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:17.943628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:17.943914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:17.944191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:17.945523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] RBAC: Adding query filter params (role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=182f0f6452a64a0d9912686b6c527f41) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:17.945897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:17.947981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:17.954833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 133/272] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:17 2022] GET /identity/v3/role_assignments?user.id=182f0f6452a64a0d9912686b6c527f41&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:18.025383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 140/273] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:18.307879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:18.328688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:18.436078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2660bb-d3c8-47c6-bf3a-48eabf54d0d7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:18.468479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848824f-ec2a-4b43-a434-b7fedf01694e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:18.471957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad57f83-fb41-4790-a1ac-f28907c238a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:18.472615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad57f83-fb41-4790-a1ac-f28907c238a7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.472901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad57f83-fb41-4790-a1ac-f28907c238a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.473203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad57f83-fb41-4790-a1ac-f28907c238a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.485226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad57f83-fb41-4790-a1ac-f28907c238a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-0ad57f83-fb41-4790-a1ac-f28907c238a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:18.490613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:18.491527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:18.492424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 134/274] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:18.493150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f413c7-9ded-4569-8c2e-a3d9b55562b2 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.494139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f413c7-9ded-4569-8c2e-a3d9b55562b2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.494139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f413c7-9ded-4569-8c2e-a3d9b55562b2 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.494946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 135/275] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:18.497437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f413c7-9ded-4569-8c2e-a3d9b55562b2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:18.514123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a286935-4aee-4230-b9ee-1e282342220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:18.514899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a286935-4aee-4230-b9ee-1e282342220a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.515264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a286935-4aee-4230-b9ee-1e282342220a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.515604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a286935-4aee-4230-b9ee-1e282342220a None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.516876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a286935-4aee-4230-b9ee-1e282342220a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:18.518451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a286935-4aee-4230-b9ee-1e282342220a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:18.520408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 141/276] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:18.521656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.521949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.522227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.540970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:18.542177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:18.543972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:18.553557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:18.614339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 142/277] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:18.614970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:18.628768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f413c7-9ded-4569-8c2e-a3d9b55562b2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:18.671226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:18.672024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.672317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.672599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.673305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:18.673616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:18.675015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd52c9-5a72-417e-a36c-c2fdbedb6377 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:18.685105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 136/278] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:18.685280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4017c5-41f8-434c-b960-270d5559b922 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.685543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4017c5-41f8-434c-b960-270d5559b922 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.685865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4017c5-41f8-434c-b960-270d5559b922 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.687082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 137/279] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:18.692312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4017c5-41f8-434c-b960-270d5559b922 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:18.732705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa1da-3c77-405a-9499-e45ff74dab85 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:18.777065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:18.777677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.777956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.778233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.778884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:18.780325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:18.804922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:18.809607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4017c5-41f8-434c-b960-270d5559b922 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:18.845554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb79d5-7f58-41de-9aa9-b82390789204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:18.846168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb79d5-7f58-41de-9aa9-b82390789204 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.846455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb79d5-7f58-41de-9aa9-b82390789204 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.846735 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb79d5-7f58-41de-9aa9-b82390789204 None admin] PATH_INFO: `/v3/users/2527596cb73d4435a4263c7a7aad051e` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.861223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb79d5-7f58-41de-9aa9-b82390789204 None admin] RBAC: Authorizing `identity:get_user(user_id=2527596cb73d4435a4263c7a7aad051e)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:18.862699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb79d5-7f58-41de-9aa9-b82390789204 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:18.864327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 138/280] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:18 2022] GET /identity/v3/users/2527596cb73d4435a4263c7a7aad051e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:18.865552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:18.865800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:18.866078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:18.884844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:18.886064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:18.953388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 139/281] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:18.954268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.027047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 143/282] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:18 2022] POST /identity/v3/users => generated 293 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:19.027886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.041371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:19.042064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:19.062107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70da4-04db-4d27-bd58-6912371d02f3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.111878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.112514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.112802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.113136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.113887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, user.id=2527596cb73d4435a4263c7a7aad051e, scope.system=all) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:19.114202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:19.115786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:19.124850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 140/283] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 30 00:54:18 2022] GET /identity/v3/role_assignments?user.id=2527596cb73d4435a4263c7a7aad051e&scope.system=all&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:19.205119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841598e-82cb-4f4f-9ec2-64d6133351db None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.242646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.249262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.249992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.250284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.250568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.265552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:19.271097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:19.272024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:19.272837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 144/284] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:19.279685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.370719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:19.379080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a519d6-a2da-4138-a1eb-e3cfc8d7ed7a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.427434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.428073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.428357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.428633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.430895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d54ad-8c74-4bbe-ab9c-dc1bbb0eeef9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.453054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:19.461013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:19.461958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:19.462789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:19.464744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 141/285] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:19.471345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.489466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.490195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:19.490483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.491959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.492609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.493760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:19.493942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:19.496433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:19.509941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 145/286] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:19.517101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.631114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31e31a-d651-46cc-b5ab-39d0dd24ea2e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.669555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.670399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.670806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.671221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] PATH_INFO: `/v3/users/87133c29581649fda783622a28bda8ce` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.672587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] RBAC: Authorizing `identity:get_user(user_id=87133c29581649fda783622a28bda8ce)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:19.673474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:19.677872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:19.681117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 146/287] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/users/87133c29581649fda783622a28bda8ce => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:19.687165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.690951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126e2f-cf5c-445d-ba8a-f909c5f145d5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.810971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94817-3c2e-47e3-b374-7babc2258a26 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:19.812157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.812821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.813137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.813419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.814379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:19.814690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:19.816173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:19.841533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 142/288] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:19.847113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.854500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:19.855187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:19.855492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:19.855788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:19.857096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:19.859199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:19.861611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 147/289] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:19.870630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:19.958125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:19.991069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8384c4a-18b2-4948-9c11-78027061b2ac None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:20.036609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:20.037212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:20.037656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:20.037743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:20.038006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] PATH_INFO: `/v3/users/d61fcfc144004d3bb299cbfe779e9466` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:20.042484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] RBAC: Authorizing `identity:get_user(user_id=d61fcfc144004d3bb299cbfe779e9466)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:20.044317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:20.046568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 143/290] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:19 2022] GET /identity/v3/users/d61fcfc144004d3bb299cbfe779e9466 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:20.052392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:20.108962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e879f-07b9-411f-850b-629e3596f50c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:20.149052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:20.152963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:20.152963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:20.152963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/87133c29581649fda783622a28bda8ce/roles/f425ddffe22342b9958e50274b62147c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:20.152963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] RBAC: Authorizing `identity:create_grant(project_id=c43a9da75a0f49fe9cb72bc94809f662, user_id=87133c29581649fda783622a28bda8ce, role_id=f425ddffe22342b9958e50274b62147c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:20.154919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:20.229371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c5b8-32e5-4db3-be11-7016a758d3f2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:20.233332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 148/291] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:54:19 2022] PUT /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/users/87133c29581649fda783622a28bda8ce/roles/f425ddffe22342b9958e50274b62147c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:20.289257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:20.290146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:20.290578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:20.291028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:20.305444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:20.391695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:20.393274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:20.515145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 144/292] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:20.522243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:20.659635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213041-63ab-4a86-8d0a-2f355ec47319 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:20.682812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:20.699137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033941fa-ba0d-49e1-8ac0-a0012b9c54a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:20.699830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033941fa-ba0d-49e1-8ac0-a0012b9c54a4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:20.700117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033941fa-ba0d-49e1-8ac0-a0012b9c54a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:20.700414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033941fa-ba0d-49e1-8ac0-a0012b9c54a4 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:20.702413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033941fa-ba0d-49e1-8ac0-a0012b9c54a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:20.703962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033941fa-ba0d-49e1-8ac0-a0012b9c54a4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:20.706164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 149/293] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:20 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:20.711709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:20.778996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:20.854165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb11cd-c003-4594-8ce0-9b50169d5e10 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:20.890569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:20.891173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:20.891455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:20.891734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:20.892468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=d61fcfc144004d3bb299cbfe779e9466) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:20.892779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:20.894424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f420c-66b4-4427-a8cd-c489e1ddaf7d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:20.901102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 145/294] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:20 2022] GET /identity/v3/role_assignments?user.id=d61fcfc144004d3bb299cbfe779e9466&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:21.392682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acf91-8461-4445-9ae4-a4636f482c4d None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:21.393218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acf91-8461-4445-9ae4-a4636f482c4d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:21.393290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acf91-8461-4445-9ae4-a4636f482c4d None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:21.394753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 150/295] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:21.401146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a494ea-5f4b-4d6f-8584-3a5e65bcfc81 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:21.401442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a494ea-5f4b-4d6f-8584-3a5e65bcfc81 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:21.401728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a494ea-5f4b-4d6f-8584-3a5e65bcfc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:21.424139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d2a494ea-5f4b-4d6f-8584-3a5e65bcfc81 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:21.425404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d2a494ea-5f4b-4d6f-8584-3a5e65bcfc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:21.528773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 146/296] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:21.610803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628fcc5-991d-4e62-9a0d-871054203317 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:21.611119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628fcc5-991d-4e62-9a0d-871054203317 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:21.611371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628fcc5-991d-4e62-9a0d-871054203317 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:21.613024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 151/297] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:21.619350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301244-199a-43df-bf1d-fbac428c28c5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:21.619641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301244-199a-43df-bf1d-fbac428c28c5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:21.619920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301244-199a-43df-bf1d-fbac428c28c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:21.639501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-73301244-199a-43df-bf1d-fbac428c28c5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:21.640707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-73301244-199a-43df-bf1d-fbac428c28c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:21.670383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:21.716564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 147/298] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:21.750652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540775d-c6f5-4fa7-91ec-a56d9fa351ec None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:21.751410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540775d-c6f5-4fa7-91ec-a56d9fa351ec None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:21.751915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540775d-c6f5-4fa7-91ec-a56d9fa351ec None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:21.753771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 152/299] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:21.759914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:21.760207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:21.760539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:21.779005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:21.780197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:21.835674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540775d-c6f5-4fa7-91ec-a56d9fa351ec None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:21.871545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 148/300] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:21.968703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540775d-c6f5-4fa7-91ec-a56d9fa351ec None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.003328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.004338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.004676 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.004977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.005484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.021949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:22.028429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:22.029391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:22.030199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 153/301] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:54:22.035821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.089219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.122529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.130648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c1172-fa62-4655-bd61-49a99d89642e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.143281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911bab-41d2-4eb4-a366-1d0d3eb68cbe None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.173520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.174681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.175019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.175445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.176592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.178369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.180069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.180684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.180988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.181270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.181929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:22.182287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 149/302] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:22.182387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.183277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.183734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.194104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 154/303] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:22.195569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.307943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e0a33-544f-4fb2-b16b-32223ccdb93d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.314641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9485-c0d7-4945-9007-535b70e50fc6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.326484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.347281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.347923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.348209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.348486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.352210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.352841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.353164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.353447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] PATH_INFO: `/v3/groups` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.354099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.355669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.360330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:22.365319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:22.366467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:22.367380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 150/304] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:22.372169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.397022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.426963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 155/305] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 30 00:54:22 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:22.427980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.518741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebe98a-6770-41a8-8236-580e41daf47e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.568805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.569772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.570499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.570940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] PATH_INFO: `/v3/users/2527596cb73d4435a4263c7a7aad051e` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.572527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] RBAC: Authorizing `identity:get_user(user_id=2527596cb73d4435a4263c7a7aad051e)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.575111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.577251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 151/306] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/users/2527596cb73d4435a4263c7a7aad051e => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:22.583777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.586061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a930d-10f4-4e4f-bbcd-000cf8bfc3db None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.634246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.634900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.635735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.636030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.636725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:22.637857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.639298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.654483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 156/307] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:22.656155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.691781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.699604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.702014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d26d8-34b2-465a-9434-ef7bffc1a45b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.746211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb512ca7-93ad-49f5-9f4a-593868bf7fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.746871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb512ca7-93ad-49f5-9f4a-593868bf7fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.747169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb512ca7-93ad-49f5-9f4a-593868bf7fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.747427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb512ca7-93ad-49f5-9f4a-593868bf7fc1 None admin] PATH_INFO: `/v3/system/users/2527596cb73d4435a4263c7a7aad051e/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.748867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb512ca7-93ad-49f5-9f4a-593868bf7fc1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2527596cb73d4435a4263c7a7aad051e, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.750291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb512ca7-93ad-49f5-9f4a-593868bf7fc1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.781906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd24c-df98-446e-bd19-dc98c2814db6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.816993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a57d7-ef82-413d-8d88-283c02c0a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:22.817642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a57d7-ef82-413d-8d88-283c02c0a35a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.817930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a57d7-ef82-413d-8d88-283c02c0a35a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.818262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a57d7-ef82-413d-8d88-283c02c0a35a None admin] PATH_INFO: `/v3/users/933acbf6d8914f4aa69d9d2cbe7a140d` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.832743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a57d7-ef82-413d-8d88-283c02c0a35a None admin] RBAC: Authorizing `identity:get_user(user_id=933acbf6d8914f4aa69d9d2cbe7a140d)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:22.834237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a57d7-ef82-413d-8d88-283c02c0a35a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:22.836747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 157/308] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/users/933acbf6d8914f4aa69d9d2cbe7a140d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:22.838994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d79e-980a-4e14-b584-4ad1629684ec None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.839300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d79e-980a-4e14-b584-4ad1629684ec None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.839575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d79e-980a-4e14-b584-4ad1629684ec None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.841058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 158/309] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:22.842822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d79e-980a-4e14-b584-4ad1629684ec None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:22.854812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 152/310] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 30 00:54:22 2022] PUT /identity/v3/system/users/2527596cb73d4435a4263c7a7aad051e/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:54:22.856403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:22.856719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:22.857052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:22.887315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:22.889118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:22.977321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:22.986258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d79e-980a-4e14-b584-4ad1629684ec None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:22.992962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 153/311] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:23.035015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:23.035694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.035978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.036261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.037102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] RBAC: Adding query filter params (role.id=f425ddffe22342b9958e50274b62147c, user.id=933acbf6d8914f4aa69d9d2cbe7a140d, scope.system=all) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:23.037420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:23.039624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:23.045674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 159/312] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 30 00:54:22 2022] GET /identity/v3/role_assignments?user.id=933acbf6d8914f4aa69d9d2cbe7a140d&scope.system=all&role.id=f425ddffe22342b9958e50274b62147c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:23.279874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:23.376438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:23.393536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a7887-f19d-4652-bb42-64e9f9253fdd None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:23.431488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:23.432494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.432981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.433462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.444638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:23.449736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:23.450609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:23.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:23.453812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 154/313] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:23.459715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:23.573087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b75ad-edc7-41ff-82ad-a9bca2af3846 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:23.615488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:23.615488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.615488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.615488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.615896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] RBAC: Adding query filter params (name=reader) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:23.615965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:23.618549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:23.628331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 160/314] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:23.633970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:23.752533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c4c1-89a3-4c81-bc36-8f12f8d7c17c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:23.793239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:23.793883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.794170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.794451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] PATH_INFO: `/v3/users/87133c29581649fda783622a28bda8ce` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:23.795587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] RBAC: Authorizing `identity:get_user(user_id=87133c29581649fda783622a28bda8ce)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:23.797136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:23.799036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 155/315] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:23 2022] GET /identity/v3/users/87133c29581649fda783622a28bda8ce => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:23.806065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:23.827304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:23.914300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681af62-452e-43f4-8ad3-d691d0eb475f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:23.952268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:23.953019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:23.953308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:23.953589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.033012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:24.034499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:24.055934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:24.144538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 161/316] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:24.154030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:24.221403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:24.270850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa70a-7444-49f7-a793-635bf1a8d07e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:24.312558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77dfa3-f884-45d5-b03d-e319b1b50c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:24.313236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77dfa3-f884-45d5-b03d-e319b1b50c01 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:24.313524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77dfa3-f884-45d5-b03d-e319b1b50c01 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:24.314200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77dfa3-f884-45d5-b03d-e319b1b50c01 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.315659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77dfa3-f884-45d5-b03d-e319b1b50c01 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:24.317161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77dfa3-f884-45d5-b03d-e319b1b50c01 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:24.319159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 156/317] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:24 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:24.325080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:24.435368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20fabd-dba3-4faf-9179-c7a58342de21 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:24.457416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:24.474017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:24.474618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:24.476099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:24.476099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.476262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] RBAC: Adding query filter params (role.id=f425ddffe22342b9958e50274b62147c, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662, user.id=87133c29581649fda783622a28bda8ce) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:24.476704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:24.478216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a59e9-a4aa-4208-adbe-e4e5518b08c4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:24.485196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 162/318] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:24 2022] GET /identity/v3/role_assignments?user.id=87133c29581649fda783622a28bda8ce&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=f425ddffe22342b9958e50274b62147c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:24.711057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758dced-8a32-4ecf-8873-1c7eb91b3a9c None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:24.711413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758dced-8a32-4ecf-8873-1c7eb91b3a9c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:24.711603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758dced-8a32-4ecf-8873-1c7eb91b3a9c None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.713228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 157/319] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:24.718837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dab1f4-6e48-4ec5-a6c5-92bef8b13ac9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:24.719128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dab1f4-6e48-4ec5-a6c5-92bef8b13ac9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:24.719411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dab1f4-6e48-4ec5-a6c5-92bef8b13ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.741627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f7dab1f4-6e48-4ec5-a6c5-92bef8b13ac9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:24.743838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f7dab1f4-6e48-4ec5-a6c5-92bef8b13ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:24.829112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 163/320] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:24.917778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a7a2-c3ef-48b9-bd69-dc6b57d043b7 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:24.918339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a7a2-c3ef-48b9-bd69-dc6b57d043b7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:24.918339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a7a2-c3ef-48b9-bd69-dc6b57d043b7 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.919787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 158/321] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:24.924671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901b36-1c75-455a-808d-cebb968c1e9a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:24.924976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901b36-1c75-455a-808d-cebb968c1e9a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:24.925262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901b36-1c75-455a-808d-cebb968c1e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:24.943927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5d901b36-1c75-455a-808d-cebb968c1e9a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:24.945985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5d901b36-1c75-455a-808d-cebb968c1e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:25.021228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 164/322] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:25.081650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cff35-2f19-413f-bbec-7fd62c2f6445 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.081951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cff35-2f19-413f-bbec-7fd62c2f6445 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.082210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cff35-2f19-413f-bbec-7fd62c2f6445 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.083684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 159/323] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:25.089295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.089585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.089866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.108767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:25.110067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:25.113480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cff35-2f19-413f-bbec-7fd62c2f6445 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.152295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:25.187981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 165/324] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:25.221279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:25.243332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cff35-2f19-413f-bbec-7fd62c2f6445 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.281083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.281937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.282429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.282843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.284106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:25.285741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:25.287773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 160/325] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:25.293587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.309513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.420230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744fe0b-a28e-4190-81e6-84cb5e5f03e6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.432597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6efe3-ad36-481b-acb6-56c3c1374517 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.461893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.462596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.462905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.463211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] PATH_INFO: `/v3/groups` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.463915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:25.465528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:25.471120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.471785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.472080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.472396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.484042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:25.489218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:25.491014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 161/326] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:25.493381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.503787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:25.556405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 166/327] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 30 00:54:25 2022] POST /identity/v3/groups => generated 226 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:54:25.557766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.601907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3837ec-110c-4d34-b9f7-d23ad48899d9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.608818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:25.641383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.642080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.642371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.642654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.654872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:25.659933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:25.660980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:25.661810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 162/328] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:25.667830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.696782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840cd97-dc73-431b-a2ed-8d7df8800dd1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.740438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.741176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.741469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.742123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.742426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:25.742739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:25.744122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:25.752687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:25.754988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 167/329] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:25.761832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.798737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecf459-016b-4aca-ac11-61cd9f5045da None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.853384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.854458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.855025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.855611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.856555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] RBAC: Adding query filter params (name=reader) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:25.857075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:25.859095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:25.873643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 163/330] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:25.879695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:25.880036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:25.889004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0d00-aacb-4fc8-8f41-775960ddd641 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:25.937690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:25.938344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:25.938629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:25.939169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] PATH_INFO: `/v3/users/2527596cb73d4435a4263c7a7aad051e` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:25.940345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] RBAC: Authorizing `identity:get_user(user_id=2527596cb73d4435a4263c7a7aad051e)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:25.941830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:25.945984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 168/331] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/users/2527596cb73d4435a4263c7a7aad051e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:25.950181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:26.034859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b683128-83cd-4cda-a7d2-121e1a38c76b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:26.080232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:26.089419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:26.090788 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:26.090788 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:26.093190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] PATH_INFO: `/v3/users/933acbf6d8914f4aa69d9d2cbe7a140d` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.093190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] RBAC: Authorizing `identity:get_user(user_id=933acbf6d8914f4aa69d9d2cbe7a140d)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:26.094446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:26.095707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736c423-b011-48e3-8375-faaaff73efdf None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:26.096436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 164/332] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/users/933acbf6d8914f4aa69d9d2cbe7a140d => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:26.101669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:26.138093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:26.139054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:26.139535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:26.140024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.141187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] RBAC: Adding query filter params (role.id=9b4d98f235024d4a90a0daee2b22a5e1, user.id=2527596cb73d4435a4263c7a7aad051e, scope.system=all) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:26.141699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:26.143483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7552-fc5e-4ef6-99af-976ae7419a74 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:26.159481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 169/333] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 30 00:54:25 2022] GET /identity/v3/role_assignments?user.id=2527596cb73d4435a4263c7a7aad051e&scope.system=all&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:26.230753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af771-f248-4b85-8c33-73d014ffd31c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:26.272207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95454d-8bed-466f-bfdd-5cb68a3581c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:26.273230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95454d-8bed-466f-bfdd-5cb68a3581c3 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:26.273230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95454d-8bed-466f-bfdd-5cb68a3581c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:26.273516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95454d-8bed-466f-bfdd-5cb68a3581c3 None admin] PATH_INFO: `/v3/system/users/933acbf6d8914f4aa69d9d2cbe7a140d/roles/f425ddffe22342b9958e50274b62147c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:26.274985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95454d-8bed-466f-bfdd-5cb68a3581c3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=933acbf6d8914f4aa69d9d2cbe7a140d, role_id=f425ddffe22342b9958e50274b62147c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:26.276531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95454d-8bed-466f-bfdd-5cb68a3581c3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:26.339320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 165/334] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 30 00:54:26 2022] PUT /identity/v3/system/users/933acbf6d8914f4aa69d9d2cbe7a140d/roles/f425ddffe22342b9958e50274b62147c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:54:28.097247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2a24-67f8-4173-b84c-c6c4c6b61353 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:28.097748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2a24-67f8-4173-b84c-c6c4c6b61353 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:28.097823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2a24-67f8-4173-b84c-c6c4c6b61353 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:28.099410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 170/335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:28.107275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b95aa-cdfa-46ca-a038-db239cf06619 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:28.107755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b95aa-cdfa-46ca-a038-db239cf06619 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:28.107830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b95aa-cdfa-46ca-a038-db239cf06619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:28.134096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6e4b95aa-cdfa-46ca-a038-db239cf06619 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:28.135334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6e4b95aa-cdfa-46ca-a038-db239cf06619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:28.213058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbd0b4-afae-4d75-88d0-943d1063720f None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:28.213729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbd0b4-afae-4d75-88d0-943d1063720f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:28.214212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbd0b4-afae-4d75-88d0-943d1063720f None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:28.216135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 171/336] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:28.221492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3502b-b9f8-47a3-afb1-0609a9d133a8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:28.222035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3502b-b9f8-47a3-afb1-0609a9d133a8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:28.222532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3502b-b9f8-47a3-afb1-0609a9d133a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:28.231045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:28.235758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 166/337] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:28.262089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a8c3502b-b9f8-47a3-afb1-0609a9d133a8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:28.263606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a8c3502b-b9f8-47a3-afb1-0609a9d133a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:28.283190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:28.348096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:28.777966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803459-dec9-4011-8a6b-e7378e7a1c01 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:28.778344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803459-dec9-4011-8a6b-e7378e7a1c01 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:28.778522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803459-dec9-4011-8a6b-e7378e7a1c01 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:28.780231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 167/339] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:28.785346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:28.785637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:28.785919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:28.811508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:28.812875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:28.848055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803459-dec9-4011-8a6b-e7378e7a1c01 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:28.911826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 173/340] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:28.913002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.019381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.042329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52f720-9239-472f-89e8-dc839cba2329 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.080161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92a1c3-6c6c-4f73-9b27-6c12d8150980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.081192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a1c3-6c6c-4f73-9b27-6c12d8150980 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.081696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a1c3-6c6c-4f73-9b27-6c12d8150980 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.082167 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92a1c3-6c6c-4f73-9b27-6c12d8150980 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.093527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92a1c3-6c6c-4f73-9b27-6c12d8150980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-da92a1c3-6c6c-4f73-9b27-6c12d8150980 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:29.098901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:29.109226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 174/341] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:29.110050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3d17-a7cb-4f7e-ba28-076ced733610 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.110742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3d17-a7cb-4f7e-ba28-076ced733610 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.110742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3d17-a7cb-4f7e-ba28-076ced733610 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.111335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 175/342] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:29.112292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3d17-a7cb-4f7e-ba28-076ced733610 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.129812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7803459-dec9-4011-8a6b-e7378e7a1c01 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.233944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3d17-a7cb-4f7e-ba28-076ced733610 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.243054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.243287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.243578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.243862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.272106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.273642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.274077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.274499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.275321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:29.275769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:29.277461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ea2c2-b933-4ab2-acc9-4c4d0336110a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:29.283755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.289575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 176/343] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:29.290080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:29.291237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.291527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.291808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:29.299622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:29.300558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 168/344] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:29.301878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.311121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:29.312329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:29.385364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.390765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 177/345] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:29.391661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.469216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548351b-89fe-4b02-9d97-5a6553fbc267 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.516297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4abc0-7bcf-4820-9d86-0cf1cc4e0100 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.548741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.566698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.566698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.566698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.566698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.577719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.578407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.578693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.578969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.591762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:29.596862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:29.597868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:29.598681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 169/346] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:29.599359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.635549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:29.637049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:29.744669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 178/347] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:29.745585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.775268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588a4cd-0b44-401f-8627-1d03018a9eb2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.779171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.801309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:29.840059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.841400 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.842157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.842794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.844253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:29.845024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:29.847392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:29.855915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dc901-ee74-4dde-8776-a7389fe10c4a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:29.863619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 170/348] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:29.865351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:29.896086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:29.896708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.897016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.897961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.898681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:29.898989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:29.900374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7170f5-a644-44e8-9ad8-638f77a9bd71 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:29.910640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 179/349] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:29.911962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845b762-abf1-4973-a0ad-9cc643e6121b None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:29.912255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845b762-abf1-4973-a0ad-9cc643e6121b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:29.912530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845b762-abf1-4973-a0ad-9cc643e6121b None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:29.914419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 180/350] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:29.914880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845b762-abf1-4973-a0ad-9cc643e6121b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.030787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.042738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845b762-abf1-4973-a0ad-9cc643e6121b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.052222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13fc4-3629-401d-aeb3-97717cdd52d6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.088499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.089170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.089461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.089742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.097607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b444e-8a26-43ac-93fd-302d8c3d8302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.098185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b444e-8a26-43ac-93fd-302d8c3d8302 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.098467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b444e-8a26-43ac-93fd-302d8c3d8302 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.098742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b444e-8a26-43ac-93fd-302d8c3d8302 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.100444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b444e-8a26-43ac-93fd-302d8c3d8302 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.101961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b444e-8a26-43ac-93fd-302d8c3d8302 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.105440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 171/351] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:30.106770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.107059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.107355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.126806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:30.128008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:30.180721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.182287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.184312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.224581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 172/352] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:30.226260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.310533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.321132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 181/353] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:30.321888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.363076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9fbbc-5122-4532-ba06-a34b4ad6f0f8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.409418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.410902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.411365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.411811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.451479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c144-2c0e-4913-bc9f-19b9733bac68 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.476266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.512547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.513825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.514286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.514735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.532166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:30.534440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.538896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:30.540840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:30.541752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:54:30.542518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:30.544892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 182/354] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:30.545881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.619586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.679832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff0184-eaa5-40f1-8f1b-8f722b48c4eb None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.690908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 173/355] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:30.692516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.723740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95c6ff-d10e-4dce-ad79-d57f7d84c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.724385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95c6ff-d10e-4dce-ad79-d57f7d84c48b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.724670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95c6ff-d10e-4dce-ad79-d57f7d84c48b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.725097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95c6ff-d10e-4dce-ad79-d57f7d84c48b None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.733114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95c6ff-d10e-4dce-ad79-d57f7d84c48b None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.734566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95c6ff-d10e-4dce-ad79-d57f7d84c48b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.736260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 183/356] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:30.737591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f6a65-bd7d-48bd-99de-d4874efa20cd None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.737883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f6a65-bd7d-48bd-99de-d4874efa20cd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.738163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f6a65-bd7d-48bd-99de-d4874efa20cd None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.739423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 184/357] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:30.740114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f6a65-bd7d-48bd-99de-d4874efa20cd None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.804208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.847025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87502a9-8590-4c3c-bbe9-29c4add223e7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.877444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f6a65-bd7d-48bd-99de-d4874efa20cd None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:30.895650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:30.901212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.902085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.902514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.902939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.906567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.909209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.911071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 174/358] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:30.912584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:30.919573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:30.920266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:30.920557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:30.920856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:30.921677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:30.922024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:30.924062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:30.936844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 185/359] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:30.937869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.043702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23965211-f7e7-49f4-aca9-adab4d8a0fa5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.081079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35afac-a570-4d4d-b3df-c03eb73613b9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.087697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.087697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.087697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.087697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.098704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:31.103374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:31.109471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:31.110402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:31.111187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 175/360] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:31.111953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.131946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c2b4-c3cf-477b-bdfa-eafdb82bf1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.132493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c2b4-c3cf-477b-bdfa-eafdb82bf1db None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.132792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c2b4-c3cf-477b-bdfa-eafdb82bf1db None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.133118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c2b4-c3cf-477b-bdfa-eafdb82bf1db None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.134245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c2b4-c3cf-477b-bdfa-eafdb82bf1db None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.135777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c2b4-c3cf-477b-bdfa-eafdb82bf1db None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.137831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 186/361] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:30 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.138673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.138957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.139236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.166146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:31.167365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:31.228497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:31.239628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e58b6-91f6-4ff1-95e7-2cebba682a09 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.255658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 187/362] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:31.268963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.283465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.284087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.284373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.284683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.287398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:31.287398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.289815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.295698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 176/363] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.296536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.392989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:31.409544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893dea-4009-436c-be3c-0667911aa3ad None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.452672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797d38d-3892-49fb-aa7a-552c7fa70284 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.465535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.466204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.466491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.466774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.468097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.469703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.471764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 188/364] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.472677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.509490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.510174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.510463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.510744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] PATH_INFO: `/v3/users/933acbf6d8914f4aa69d9d2cbe7a140d` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.512007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] RBAC: Authorizing `identity:get_user(user_id=933acbf6d8914f4aa69d9d2cbe7a140d)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.515235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.515235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 177/365] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/users/933acbf6d8914f4aa69d9d2cbe7a140d => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.515903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.546233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:31.620889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeefc2b-f717-4440-8c58-36da2d36c329 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.656994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a597c2-44b7-41d7-b037-a7aba4f56c56 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.668800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.669486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.669775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.670056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.670736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:31.671048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.672430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.683610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.684483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.693228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:31.702738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.703430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.703691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.709145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.709145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.709145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.709145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 178/367] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.709145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.829267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe352dc-2951-4cf5-a0ad-44e7cf20245a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.840556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:31.849857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c41db-59e6-4dd6-88f4-dcc91908f956 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:31.874509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.875124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.875771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.876597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.877947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:31.878258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.879695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.887151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 190/368] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.887819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.892347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:31.893009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:31.893302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:31.893584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:31.894351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] RBAC: Adding query filter params (role.id=f425ddffe22342b9958e50274b62147c, user.id=933acbf6d8914f4aa69d9d2cbe7a140d, scope.system=all) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:31.894670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:31.896201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:31.912620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 179/369] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/role_assignments?user.id=933acbf6d8914f4aa69d9d2cbe7a140d&scope.system=all&role.id=f425ddffe22342b9958e50274b62147c => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:31.914205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:31.988565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.044462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aff19-50ce-4c66-ba0f-66f1831651ed None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.046435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9263df-8603-4070-aa1a-90e9714a5d60 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.085715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.086328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.086612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.086888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.090920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.091892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.092380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.092861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.106665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:32.113533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:32.114493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:32.115292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:32.118600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 191/370] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:32.119719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:32.161874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.169343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:32.170838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:32.236680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.252814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8924ffb-e3fe-455f-a5a2-fde11768980b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.301843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 180/371] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:32.302798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:32.305553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.307721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.308173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.308675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.309609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:32.310076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:32.311691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:32.320856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 192/372] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:32 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:32.322651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:32.468599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5eedc1-1d15-46c2-8aa1-ca05d77d3598 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.508150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.515282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.516258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.516780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.517317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.518220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:32.518738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:32.520393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:32.534015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 181/373] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:32.539251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834297-10d5-484e-9623-5c577fe97f82 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.540143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:32.572818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.618187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.618860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.619142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.619415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.622479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:32.623600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:32.625688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 193/374] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:32 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:32.631146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:32.673947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3030620-2115-4674-87d9-42abc2c5aaea None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.752026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.752888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.753396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.753853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.821719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa0517-d918-4c9a-ba41-0290cd2ca6a1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:32.872832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:32.874796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:32.890429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:32.891354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:32.891786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:32.892207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:32.893558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:32.895281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:32.897137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 194/375] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:32 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:32.903875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:32.924122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:32.992962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:33.083110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 182/376] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:54:33.089495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:33.146299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516b33a-1ef2-40d5-a36f-3758b2c20e54 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:33.219924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec7e90-231f-4665-92cf-ad58350219e9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:33.250700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:33.251383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.251531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:33.252042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.252042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.252667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:33.253022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:33.254461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:33.270864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 195/377] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:32 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 260 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:33.277745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:33.278862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.279360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.279940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] PATH_INFO: `/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.281924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7dff46aac1450a9c4f3cfcc96d1d48)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:33.283638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:33.289128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 183/378] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:33 2022] GET /identity/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:33.294221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:33.459252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:33.467880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b108f7-746b-4f80-91bd-8f2bd1f8698b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:33.516314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacf46e-a0a8-4f6f-a788-31946a3b2878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:33.517009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacf46e-a0a8-4f6f-a788-31946a3b2878 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.517302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacf46e-a0a8-4f6f-a788-31946a3b2878 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.517585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacf46e-a0a8-4f6f-a788-31946a3b2878 None admin] PATH_INFO: `/v3/groups/9a89e9745c634c94853ac8aec995d03b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.527644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacf46e-a0a8-4f6f-a788-31946a3b2878 None admin] RBAC: Authorizing `identity:get_group(group_id=9a89e9745c634c94853ac8aec995d03b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:33.529663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacf46e-a0a8-4f6f-a788-31946a3b2878 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:33.531677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 196/379] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:33 2022] GET /identity/v3/groups/9a89e9745c634c94853ac8aec995d03b => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:33.537679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:33.668665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28478e59-fa2f-4721-bef0-8cd0b7cc9b43 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:33.721827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:33.722791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.723283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.723810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.724763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] RBAC: Adding query filter params (group.id=9a89e9745c634c94853ac8aec995d03b, role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=8e7dff46aac1450a9c4f3cfcc96d1d48) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:33.725492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:33.727216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c96d-dc38-4dd3-8e1a-f5e8c4e10284 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:33.734047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 184/380] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:33 2022] GET /identity/v3/role_assignments?group.id=9a89e9745c634c94853ac8aec995d03b&scope.project.id=8e7dff46aac1450a9c4f3cfcc96d1d48&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:33.870857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dc09-ecf4-4bb5-b951-9393c2b78a67 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.871527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dc09-ecf4-4bb5-b951-9393c2b78a67 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.872018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dc09-ecf4-4bb5-b951-9393c2b78a67 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.874026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 197/381] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:33.879470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:33.880105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:33.880607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:33.903226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:33.904797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:33.974009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:34.001143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 185/382] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:34.400804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dc09-ecf4-4bb5-b951-9393c2b78a67 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:34.530793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dc09-ecf4-4bb5-b951-9393c2b78a67 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:34.571118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfee1c-0ce8-41d9-a01c-bc1a44b20123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:34.572221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfee1c-0ce8-41d9-a01c-bc1a44b20123 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:34.572730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfee1c-0ce8-41d9-a01c-bc1a44b20123 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:34.573235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfee1c-0ce8-41d9-a01c-bc1a44b20123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:34.584347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfee1c-0ce8-41d9-a01c-bc1a44b20123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-23bfee1c-0ce8-41d9-a01c-bc1a44b20123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:34.590710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:34.591648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:34.592539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:34.599162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 198/383] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:34.601974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:34.619753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d05b-7280-4dfe-a61b-f195c154a4a6 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:34.620386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d05b-7280-4dfe-a61b-f195c154a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:34.620850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d05b-7280-4dfe-a61b-f195c154a4a6 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:34.622820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 199/384] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:54:34.628000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:34.628514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:34.629019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:34.650987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:34.652164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:34.675221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:34.730984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 200/385] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:34.772769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f5b2f-7516-4e15-a643-7ff2e441cabc None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:34.831469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:34.832402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:34.832876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:34.833351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:34.834209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:34.835313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:34.836867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5a5d-219a-4288-8519-fe02688a7357 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:34.848435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 186/386] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:34.855541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:34.938202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ddf9b-ca24-4f59-b3b5-4720f29a77e8 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:34.939088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ddf9b-ca24-4f59-b3b5-4720f29a77e8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:34.939671 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ddf9b-ca24-4f59-b3b5-4720f29a77e8 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:34.941367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 187/387] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:34.957304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:34.957657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:34.958029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:34.986893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:34.988182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:35.007392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d208a-e241-48f9-9815-1f8173328619 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.062626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.064423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.065860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.066124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.067377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:35.069016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:35.072453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 201/388] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:34 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:35.077131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.077636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:35.108320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 188/389] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:35.109545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.137342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:35.208222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c94b-4ec8-4646-948b-b690d2089893 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.245678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b541089-4705-411a-8fb8-89136f074d8f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.295173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.296209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.296694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.297208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.298155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.298797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.299079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.299356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.300484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:35.301938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:35.304698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 202/390] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:35 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:35.310276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.315368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:35.321059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:35.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:35.322750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:35.325370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 189/391] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:35.334072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.374694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:35.448814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088779b-0ab6-4a12-a25d-42d81fa87b7e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.494053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:35.496529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.497368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.497814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.498250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.499131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:35.499585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:35.501153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:35.516799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 190/392] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:35.522963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.529679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ad2bd-92e2-4e85-997a-d0424f548bdc None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.584229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.585022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.585388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.585679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/groups/a87ad1b76b064952bf49dac9dabe356b/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.587718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd22d1d1cf247f9a75db22834d80afd, group_id=a87ad1b76b064952bf49dac9dabe356b, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:35.589259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:35.631864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:35.638240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953c8c-fdba-423d-8c75-61996a0f2e54 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.695412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.696072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.696352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.696626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.697831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:35.699281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:35.705147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 191/393] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:35 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:35.705147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.715161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 203/394] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 30 00:54:35 2022] PUT /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/groups/a87ad1b76b064952bf49dac9dabe356b/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:54:35.716005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.839445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e25a3-f7ce-4904-9336-47cdc9968282 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.845981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d91e5-1fd4-4117-8533-dab150b9a6b8 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:35.884428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209788ff-a3ee-4a3f-b58e-a0bc3c16adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.885209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209788ff-a3ee-4a3f-b58e-a0bc3c16adcb None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.885573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209788ff-a3ee-4a3f-b58e-a0bc3c16adcb None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.885856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209788ff-a3ee-4a3f-b58e-a0bc3c16adcb None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.886918 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beefe6c-9417-4a4c-ae83-1174801074d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:35.887262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209788ff-a3ee-4a3f-b58e-a0bc3c16adcb None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:35.887564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beefe6c-9417-4a4c-ae83-1174801074d8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.887849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beefe6c-9417-4a4c-ae83-1174801074d8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.888125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beefe6c-9417-4a4c-ae83-1174801074d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.888722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209788ff-a3ee-4a3f-b58e-a0bc3c16adcb None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:35.891513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 204/395] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:35 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:35.892657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194370b-5fdb-4ac5-963c-8e9e60871e27 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.892980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194370b-5fdb-4ac5-963c-8e9e60871e27 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.898470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194370b-5fdb-4ac5-963c-8e9e60871e27 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.900174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 205/396] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:35.900907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194370b-5fdb-4ac5-963c-8e9e60871e27 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:35.904913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beefe6c-9417-4a4c-ae83-1174801074d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2beefe6c-9417-4a4c-ae83-1174801074d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:35.910412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:35.911318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:35.912112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 192/397] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:35.914144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:35.914144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:35.914423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:35.917588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:35.934595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:35.935802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:35.958211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.012652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 193/398] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:36.013918 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.030018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194370b-5fdb-4ac5-963c-8e9e60871e27 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.123320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f0fe7-bdf1-461a-924f-def706450f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.123917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f0fe7-bdf1-461a-924f-def706450f4e None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.124174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f0fe7-bdf1-461a-924f-def706450f4e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.124451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f0fe7-bdf1-461a-924f-def706450f4e None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/groups/a87ad1b76b064952bf49dac9dabe356b/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.129357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68e8bb-469b-4bf6-b6e9-7e0efcc627ef None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.132148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f0fe7-bdf1-461a-924f-def706450f4e None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd22d1d1cf247f9a75db22834d80afd, group_id=a87ad1b76b064952bf49dac9dabe356b, role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:36.134495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f0fe7-bdf1-461a-924f-def706450f4e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:36.169050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.170070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.170532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.170989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.171909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] RBAC: Adding query filter params (name=member) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:36.172393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:36.174087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f3c0-ee34-416e-80f6-ff8efb93e32c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:36.183833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 194/399] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:36.185389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8adadf-27d7-434b-bf41-bc811efdf863 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.185941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8adadf-27d7-434b-bf41-bc811efdf863 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.186391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8adadf-27d7-434b-bf41-bc811efdf863 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.188043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 195/400] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:36.192804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8adadf-27d7-434b-bf41-bc811efdf863 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.211886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.255884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 206/401] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 30 00:54:35 2022] PUT /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd/groups/a87ad1b76b064952bf49dac9dabe356b/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:36.255884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.255884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.255884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.286294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:36.289998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:36.346525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8adadf-27d7-434b-bf41-bc811efdf863 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.371393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 207/402] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:36.372490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.375005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.401192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.401849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.402136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.402418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.403597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:36.405108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:36.411681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 196/403] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:36.413452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.536817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.552773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb20a-4311-4c98-9637-7b98291fa881 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.557325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd914e-351f-494c-bca8-d72ed1c56904 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.601217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.601866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.602150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.602427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.604930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:36.606407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:36.609484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.610125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.610408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.610691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.616140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 197/404] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:36.625980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:36.626127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:36.631837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:36.632714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:36.633542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:36.634162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 208/405] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:36.644393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.740783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.778496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dcf5e-49df-4226-8cc1-c6fff3ac24be None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.793447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32347f84-56fa-4c80-866d-7a81a8bb8e52 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:36.826977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.827918 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.828215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.828496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/groups/a87ad1b76b064952bf49dac9dabe356b/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.830564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] RBAC: Authorizing `identity:create_grant(project_id=c43a9da75a0f49fe9cb72bc94809f662, group_id=a87ad1b76b064952bf49dac9dabe356b, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:36.832021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:36.832753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:36.833660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:36.834143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:36.835450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:36.836717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:36.837426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:36.839207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:36.848998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 209/406] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:36.850192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.936303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 198/407] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 30 00:54:36 2022] PUT /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/groups/a87ad1b76b064952bf49dac9dabe356b/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:36.937366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:36.974283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:36.983364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effefd05-3fad-4039-be18-22dd18e462d0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.042920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:37.066099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.073010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.073010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.073010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.093367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:37.098406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:37.099356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:37.100803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 210/408] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:37.114085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:37.180575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dc797-888e-4f54-8bfd-c6e2a0e13817 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.222008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.222976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.223455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.223942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.225585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.227378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.229572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 199/409] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:36 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:37.236870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:37.257286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b12549-3deb-49ab-a958-4410d34575aa None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.344288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:37.346746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.347087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.347377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.347706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.348395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:37.348704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.352455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.375533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5ee86-b811-49af-9db7-c0071c773c16 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.382303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 211/410] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:37.389416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:37.463497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.464579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.465808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.466507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.469883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.471561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.479007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 200/411] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:37 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:37.483767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:37.512831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:37.640428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934505f-b088-4c63-8108-ecb8b583ccda None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.720508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.721173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.721456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.721724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] PATH_INFO: `/v3/groups/9a89e9745c634c94853ac8aec995d03b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.726528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd0a43-8fe1-4aa5-9cc6-80936e18e877 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.728195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] RBAC: Authorizing `identity:get_group(group_id=9a89e9745c634c94853ac8aec995d03b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.729726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.735277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 212/412] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:37 2022] GET /identity/v3/groups/9a89e9745c634c94853ac8aec995d03b => generated 229 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:37.742563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:37.797707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.798457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.798744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.799023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/groups/a87ad1b76b064952bf49dac9dabe356b/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.806201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] RBAC: Authorizing `identity:create_grant(project_id=c43a9da75a0f49fe9cb72bc94809f662, group_id=a87ad1b76b064952bf49dac9dabe356b, role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.810132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.900553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 201/413] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 30 00:54:37 2022] PUT /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662/groups/a87ad1b76b064952bf49dac9dabe356b/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:37.907050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d5376-f897-48c8-aeaa-61a309e75fa3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:37.930463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:37.968186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235ac85-2ac7-46eb-b2e1-270d5d051e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:37.968846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ac85-2ac7-46eb-b2e1-270d5d051e08 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.969187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ac85-2ac7-46eb-b2e1-270d5d051e08 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.969468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ac85-2ac7-46eb-b2e1-270d5d051e08 None admin] PATH_INFO: `/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:37.971739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235ac85-2ac7-46eb-b2e1-270d5d051e08 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7dff46aac1450a9c4f3cfcc96d1d48)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:37.973258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235ac85-2ac7-46eb-b2e1-270d5d051e08 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:37.975753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 213/414] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:37 2022] GET /identity/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:37.981395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:37.998684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cdf0c-c6ea-43e1-96b1-14297ceec403 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:37.999004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cdf0c-c6ea-43e1-96b1-14297ceec403 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:37.999392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cdf0c-c6ea-43e1-96b1-14297ceec403 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:38.000737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 214/415] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:38.004060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:38.020282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aae22-2083-40f8-ab74-271d06ad72e9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:38.023423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aae22-2083-40f8-ab74-271d06ad72e9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:38.023423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aae22-2083-40f8-ab74-271d06ad72e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:38.070673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7c4aae22-2083-40f8-ab74-271d06ad72e9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:38.074567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7c4aae22-2083-40f8-ab74-271d06ad72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:38.223375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 215/416] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:38.227673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9969d-607a-4c84-840d-909a6593b34b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:38.269425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:38.270086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:38.270369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:38.270647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] PATH_INFO: `/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48/groups/9a89e9745c634c94853ac8aec995d03b/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:38.273334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7dff46aac1450a9c4f3cfcc96d1d48, group_id=9a89e9745c634c94853ac8aec995d03b, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:38.275432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:38.391516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 202/417] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 30 00:54:37 2022] PUT /identity/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48/groups/9a89e9745c634c94853ac8aec995d03b/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:54:38.567090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904e29-1bdd-4c17-99b9-6b505f491994 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:38.567272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904e29-1bdd-4c17-99b9-6b505f491994 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:38.567552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904e29-1bdd-4c17-99b9-6b505f491994 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:38.570028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 216/418] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:38.571711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:38.575677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:38.575958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:38.576235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:38.614378 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:38.615645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:38.670840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:38.730614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 217/419] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 00:54:38.731826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686862-557f-4bd0-88f7-1917ad09d660 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:38.797529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:38.798171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:38.798716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:38.798716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:38.816969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:38.822527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:38.823419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:38.824220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 203/420] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:38.831112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:38.904595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:38.980767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb9e12-1cda-4dab-a25b-27f8b3c64876 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.030068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.031058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.031534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.032019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.032889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:39.033407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:39.034962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:39.044512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 218/421] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:39.054048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.166592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff979a-fc39-4597-bf80-22292a34417b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.198873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:39.206142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed6cb0-ab36-459b-9e83-bb6505fc8e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.206755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed6cb0-ab36-459b-9e83-bb6505fc8e98 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.207039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed6cb0-ab36-459b-9e83-bb6505fc8e98 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.207312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed6cb0-ab36-459b-9e83-bb6505fc8e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.267609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.322128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed6cb0-ab36-459b-9e83-bb6505fc8e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:39.323633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed6cb0-ab36-459b-9e83-bb6505fc8e98 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:39.405043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde4157-cc5c-4b76-8c05-82c8e4d33fc2 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.407371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:39.450713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06354862-6645-4741-8cea-a8649be75531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.451381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06354862-6645-4741-8cea-a8649be75531 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.451577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 204/422] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:39.451675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06354862-6645-4741-8cea-a8649be75531 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.451925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06354862-6645-4741-8cea-a8649be75531 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.452810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ff04-6317-4f9f-acae-c1d50beda668 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.453135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ff04-6317-4f9f-acae-c1d50beda668 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.453412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ff04-6317-4f9f-acae-c1d50beda668 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.458881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 205/423] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:39.460449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ff04-6317-4f9f-acae-c1d50beda668 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.471128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06354862-6645-4741-8cea-a8649be75531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-06354862-6645-4741-8cea-a8649be75531 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:39.478091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:39.479053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:39.479849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:39.484959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 219/424] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:39.484959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.484959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.484959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.500915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:39.513203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:39.523988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:39.595352 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 220/425] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:39.596672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.614560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ff04-6317-4f9f-acae-c1d50beda668 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.700272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.700986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.701427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.701768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.704693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:39.706159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:39.708136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 206/426] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:39.714003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.721896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:39.729904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a0b32-12c1-495f-ae03-2c570df2a763 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.773767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.775071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.775505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.775959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.777322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:39.777913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:39.779459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:39.790336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 221/427] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:39.796462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:39.908100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b3f8c-3101-415d-aa53-6f1e2ca37346 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:39.966820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:39.968106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:39.968820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:39.969569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:39.995988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.007319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765051-d5ac-414f-9075-490ba7f86667 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.010269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.045103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.046079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.046609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.047100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.048411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.050112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.052360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 207/428] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:40.054266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.071321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.073986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.167055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bf8d3-cf1d-412f-b288-86c86bbc16ec None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.206830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 222/429] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:40.210713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.213799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.214685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.215160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.215644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] PATH_INFO: `/v3/roles/member` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.232158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:40.238529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:40.239438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:54:40.240219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:40.245107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 208/430] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:40.246238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.275049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.290468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.348268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c78f-9376-4fe5-a7fe-1b1409e27d7e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.364637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccfad0-cd6f-436e-baf2-af88c2d0155b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.388200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.389289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.389768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.390251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.391254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:40.391812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.393573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.401208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 223/431] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:40.402267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.422587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.423242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.423523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.423794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] PATH_INFO: `/v3/projects/4bd22d1d1cf247f9a75db22834d80afd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.425659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd22d1d1cf247f9a75db22834d80afd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.427222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.440785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 209/432] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/projects/4bd22d1d1cf247f9a75db22834d80afd => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:40.441789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.577762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d4821-286f-4b3c-b376-2a8cfd3bd30f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.604523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.607187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.618360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aec6df-e1d8-4bb3-9db0-f84f146e3fe0 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.625205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.625205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.625205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.625205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.625947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] RBAC: Adding query filter params (name=member) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:40.625947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.627329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa475b-0de5-4e36-a414-364673806694 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.645022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 224/433] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:40.646441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c773c-1462-4cc5-92dd-328193832480 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.646795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c773c-1462-4cc5-92dd-328193832480 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.647080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c773c-1462-4cc5-92dd-328193832480 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.648358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 225/434] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:40.650964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7b85e-4c73-4397-b538-50cd231f55bc None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.660624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7b85e-4c73-4397-b538-50cd231f55bc None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.660624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7b85e-4c73-4397-b538-50cd231f55bc None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.660624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 226/435] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:40.660624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7b85e-4c73-4397-b538-50cd231f55bc None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.666056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b018663-b19f-4c75-afc3-0433e30b2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.666710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018663-b19f-4c75-afc3-0433e30b2862 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.667005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018663-b19f-4c75-afc3-0433e30b2862 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.667272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018663-b19f-4c75-afc3-0433e30b2862 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.669201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018663-b19f-4c75-afc3-0433e30b2862 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.670800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018663-b19f-4c75-afc3-0433e30b2862 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.672670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 210/436] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:40.673968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e190a-d834-401f-bbad-71b3e40d605f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.674249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e190a-d834-401f-bbad-71b3e40d605f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.674616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e190a-d834-401f-bbad-71b3e40d605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.695320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-430e190a-d834-401f-bbad-71b3e40d605f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:40.696510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-430e190a-d834-401f-bbad-71b3e40d605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:40.784575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 211/437] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:40.785839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7b85e-4c73-4397-b538-50cd231f55bc None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:40.786256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.786256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.786400 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.808100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:40.812044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:40.832288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:40.833287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:40.833786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:40.834072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:40.889576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:40.891188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 212/438] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:40.900514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:40.910576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:40.912560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:40.926967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.027325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f030a0-6cc5-4797-b9e6-fe94cade8f77 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.030478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 227/439] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:41.040155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.064953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.065577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.065858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.066137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.066872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=4bd22d1d1cf247f9a75db22834d80afd) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:41.067182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.069367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.076524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 213/440] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:40 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=4bd22d1d1cf247f9a75db22834d80afd&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:41.082068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.130504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.152272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf185607-e591-4d13-af2b-3352dd2b3315 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.186560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.194882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.195545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.195816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.196093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.197433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.198801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.205178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 228/441] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:41.205178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.209984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a33d90-ea1e-4d37-b019-d796d3bbd14c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.249339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.251027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.251369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.251645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.264123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:41.269523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:41.270672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:41.272235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:41.276193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 214/442] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:41.277617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.349355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cfe59-eda9-4668-b1c7-44162eeb14d6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.389479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.390114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.390403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.390689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.405196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:41.410547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:41.411449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:54:41.412998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:41.413612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da740dc2-f0e7-42c0-a1cd-f7b4310e1904 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.414168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 229/443] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:41.414846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.435552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.465118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.465797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.466084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.466364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.467529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.469051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.473110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 215/444] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:41.473110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.489669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.540568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd68bb-bef0-4c33-8e1c-c3913c4c7d99 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.576259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.576997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.577283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.577594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.578254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:41.578513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae8a9b-f752-4fa0-9e99-e614f5919765 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.578631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.579914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.587973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 230/445] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:41.588764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.613939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.614572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.614852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.615127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.616364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:41.616670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.618095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.626333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 216/446] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:41.627128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.663304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.693087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120aada-6a0f-4e6a-834e-778f3abb7d0c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.703763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.728538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.728791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5dc60-6f88-4ed6-8b79-4e311972857b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.729179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.729463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.729745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.730477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=9b4d98f235024d4a90a0daee2b22a5e1, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:41.730786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.732239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.738662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 231/447] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=9b4d98f235024d4a90a0daee2b22a5e1 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:41.739205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:41.785573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.786318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.786692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.787039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.857718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3f1b-9096-4492-af4d-450a67e26f0d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:41.869879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.871291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.897727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:41.898404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:41.898800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:41.900121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:41.909427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.962188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:41.988340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:41.990016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:41.997979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 217/448] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:42.003582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.122680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 232/449] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:42.128441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.132798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c5eed-90d7-4b7a-93c2-5ed62519a5a5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.162376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:42.167242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.167885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.168168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.168497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] PATH_INFO: `/v3/projects/c43a9da75a0f49fe9cb72bc94809f662` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.169613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] RBAC: Authorizing `identity:get_project(project_id=c43a9da75a0f49fe9cb72bc94809f662)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.171061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.172784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 218/450] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/projects/c43a9da75a0f49fe9cb72bc94809f662 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:42.178086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.221235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:42.227807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3585c8-1d8a-4c8e-bcf5-bec87cd880b2 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.262389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.263022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.263306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.263588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] PATH_INFO: `/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.264725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7dff46aac1450a9c4f3cfcc96d1d48)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.266210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.268038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 233/451] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/projects/8e7dff46aac1450a9c4f3cfcc96d1d48 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:42.274969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.278411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2080-35a8-4120-9c54-60605a2adb86 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.320021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.320663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.320969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.321253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] PATH_INFO: `/v3/groups/a87ad1b76b064952bf49dac9dabe356b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.322393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] RBAC: Authorizing `identity:get_group(group_id=a87ad1b76b064952bf49dac9dabe356b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.323865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.325481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 219/452] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/groups/a87ad1b76b064952bf49dac9dabe356b => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:42.331166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.378487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba82c4-7e17-48a8-85ac-6cd462dc6cb7 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.381424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:42.413914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.414643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.414931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.415206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] PATH_INFO: `/v3/groups/9a89e9745c634c94853ac8aec995d03b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.416482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] RBAC: Authorizing `identity:get_group(group_id=9a89e9745c634c94853ac8aec995d03b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.417963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.419555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 234/453] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/groups/9a89e9745c634c94853ac8aec995d03b => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:42.425511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:42.434590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c7bfa-e2b7-4af4-bb01-102fec82fb49 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.446416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:42.470031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.470638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.470920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.471198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.471932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] RBAC: Adding query filter params (group.id=a87ad1b76b064952bf49dac9dabe356b, role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=c43a9da75a0f49fe9cb72bc94809f662) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:42.472241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.473737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80393-15ef-4d18-8fea-7333cbc1d00c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.480921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 220/454] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/role_assignments?group.id=a87ad1b76b064952bf49dac9dabe356b&scope.project.id=c43a9da75a0f49fe9cb72bc94809f662&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:42.536541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16e3fb-88fa-44da-8f11-c9a819d8201e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:42.573402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:42.574084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:42.574367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:42.574664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:42.575415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] RBAC: Adding query filter params (group.id=9a89e9745c634c94853ac8aec995d03b, role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=8e7dff46aac1450a9c4f3cfcc96d1d48) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:42.575727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:42.577206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5129-4e6d-4cb6-ba61-3dc62b02ff5e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:42.583640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 235/455] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 30 00:54:42 2022] GET /identity/v3/role_assignments?group.id=9a89e9745c634c94853ac8aec995d03b&scope.project.id=8e7dff46aac1450a9c4f3cfcc96d1d48&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:45.011141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87d6d-7115-4b79-b4a2-a6c8b765aa51 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.011650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87d6d-7115-4b79-b4a2-a6c8b765aa51 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.011753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87d6d-7115-4b79-b4a2-a6c8b765aa51 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.013288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 221/456] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:45.018765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1af5a-af6b-4145-93c1-9f39150ff4d5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.019198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1af5a-af6b-4145-93c1-9f39150ff4d5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.019369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1af5a-af6b-4145-93c1-9f39150ff4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.040343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-37f1af5a-af6b-4145-93c1-9f39150ff4d5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:45.041832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-37f1af5a-af6b-4145-93c1-9f39150ff4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:45.075618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:45.101340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40410006-3c2a-49f2-99ca-c4effbc8a435 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.101976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40410006-3c2a-49f2-99ca-c4effbc8a435 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.102471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40410006-3c2a-49f2-99ca-c4effbc8a435 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.104270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 222/457] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:45.109927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b491966-99db-47b3-9b01-223b81e1fdff None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.110489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b491966-99db-47b3-9b01-223b81e1fdff None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.110961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b491966-99db-47b3-9b01-223b81e1fdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.138489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 236/458] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:45.143499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2b491966-99db-47b3-9b01-223b81e1fdff None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:45.144707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2b491966-99db-47b3-9b01-223b81e1fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:45.237423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 223/459] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:45.329406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b834b-ea94-4f1b-af4e-b6455a995c1d None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.329696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b834b-ea94-4f1b-af4e-b6455a995c1d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.329886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b834b-ea94-4f1b-af4e-b6455a995c1d None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.331344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 237/460] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:45.336517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.336804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.337108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.361884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:45.363060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:45.462471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 224/461] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:45.540614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b834b-ea94-4f1b-af4e-b6455a995c1d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:45.623018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:45.682691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:45.705034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b834b-ea94-4f1b-af4e-b6455a995c1d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:45.777476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:45.778117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.778393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.778669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.809970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:45.811845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:45.817999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9445-499c-4076-bda5-8126c0562118 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:45.830726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:45.831879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:45.832929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:45.832929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:45.832929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:45.835414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 238/462] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:45.837349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:45.858868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:45.862192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:45.863258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:45.863554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:45.863831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:45.876992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:45.878381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:45.903473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:45.904448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:45.905345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:45.905345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:45.905345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:45.905345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 225/463] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:54:45.910968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:45.963233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb85c2-8f84-44e7-ac21-14fb35ae80fe None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.002200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.003187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.003673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.004192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.016600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.018502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.020268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:46.036782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:46.039340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:46.040198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:46.040198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:46.040198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:46.040367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3deed4-9ba7-4c06-8848-b13e93377ca8 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.046663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 239/464] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:46.047737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:46.079921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.080602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.080875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.081184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.082096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:46.082423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.084674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.104293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 226/465] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:46.106210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:46.139724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:46.172010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a6317-b6d0-451a-b6b7-2f81014e2969 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.206584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.207191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.207471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.207746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.208391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:46.208696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.210853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.226768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0683-3b3c-4a50-b7ca-7ef533011596 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.228968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 240/466] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:46.229848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:46.271690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.272524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.272809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.273121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.273774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:46.274200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.275720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5200-d5c9-48a8-9361-5f13b392ee1c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.293060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 227/467] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:46.294740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457f7e-5f5e-4807-bc3e-e24dffe851c0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.295039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457f7e-5f5e-4807-bc3e-e24dffe851c0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.295327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457f7e-5f5e-4807-bc3e-e24dffe851c0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.300842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 228/468] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:46.300842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457f7e-5f5e-4807-bc3e-e24dffe851c0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:46.308696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:46.337811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b2aa2-759e-429f-8e7e-df80b0e03aeb None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.367438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:46.373666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.374279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.374560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.374833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.375489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.376955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.409579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457f7e-5f5e-4807-bc3e-e24dffe851c0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.442419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd87e-d14d-4cb0-ac3d-8f63e75f02f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.443020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd87e-d14d-4cb0-ac3d-8f63e75f02f8 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.443299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd87e-d14d-4cb0-ac3d-8f63e75f02f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.443572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd87e-d14d-4cb0-ac3d-8f63e75f02f8 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.444788 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfd87e-d14d-4cb0-ac3d-8f63e75f02f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.446417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfd87e-d14d-4cb0-ac3d-8f63e75f02f8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.493490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 241/469] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:46 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:46.494319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:46.571778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 229/470] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:46 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:46.571778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c10e3-390f-4f9d-9fa9-185879b98f06 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.571778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c10e3-390f-4f9d-9fa9-185879b98f06 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.571778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c10e3-390f-4f9d-9fa9-185879b98f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.614876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-319c10e3-390f-4f9d-9fa9-185879b98f06 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:46.619997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-319c10e3-390f-4f9d-9fa9-185879b98f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:46.673055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5886-70b4-44bf-b7a3-c2050971f8b7 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:46.711965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:46.722055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:46.723031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.725892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.725892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.725892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:46.726110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 230/471] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:46.729849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f1438-93ff-4888-a6fe-84ec5c81be9b None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.729849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f1438-93ff-4888-a6fe-84ec5c81be9b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.729849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f1438-93ff-4888-a6fe-84ec5c81be9b None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.729849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 231/472] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:46.732075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:46.738235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:46.738532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:46.738813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:46.763146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:46.764683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:46.839452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 232/473] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:46.939595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 242/474] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:46 2022] POST /identity/v3/users => generated 248 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:47.016056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:47.148580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd96622-b3eb-4d62-bb87-4e8d00b877b5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:47.176584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:47.179254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:47.192597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:47.193159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.193447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.193782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.205209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:47.206839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:47.227333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:47.228289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:47.229177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:47.229177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:47.229177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:47.229177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 233/475] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:47.234323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:47.235123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:47.301440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b209a5-dc2c-4a98-b060-2491a69828c9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:47.348273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:47.348918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.350935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.350935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.350935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:47.354464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:47.384749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5745-2671-4e4f-9c2f-648c8f455462 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:47.419174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.sql.core [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:54:47.419174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:54:47.419174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [parameters: {'id': 'c7666a3b88cc425193f6b9563f8d8455', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:54:47.419174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89119) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:54:47.436298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:47.437288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.437804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.438276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.439393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:47.439944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result.read() Aug 30 00:54:47.441735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:54:47.442671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application yield resource Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise self.value Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application session.commit() Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:54:47.443688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:54:47.445271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:54:47.446131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result.read() Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:54:47.446927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [parameters: {'id': 'c7666a3b88cc425193f6b9563f8d8455', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:47.447710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:54:47.450564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:47.452714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 243/476] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 30 00:54:47 2022] POST /identity/v3/roles => generated 144 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:47.452857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:47.453031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:47.474126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 234/477] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:47.480608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:47.527858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:47.640049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8256de-c039-43c3-ba60-93fa3df094ef None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:47.681067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:47.681760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.682115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.682600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.683271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:47.684837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:47.695079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6412-725a-4af5-9b07-311ece7c3fea None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:47.711653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:47.742228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6335991-d8d7-45e4-b1ab-0431334de2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:47.743204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6335991-d8d7-45e4-b1ab-0431334de2b8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:47.743636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6335991-d8d7-45e4-b1ab-0431334de2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:47.744090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6335991-d8d7-45e4-b1ab-0431334de2b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:47.755419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6335991-d8d7-45e4-b1ab-0431334de2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-b6335991-d8d7-45e4-b1ab-0431334de2b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:47.764414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:47.765577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:54:47.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:47.770809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 235/478] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:47 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:47.779804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 244/479] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:54:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:47.781649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:47.939194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:47.954264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68b58-c4b4-403e-a334-9cb034b2d6f1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:48.004186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:48.005225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:48.005512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:48.005816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:48.007783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:48.008097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:48.009942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf253a-3228-42f2-afc3-dbb960f4c24f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:48.023338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 236/480] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:49.045404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c04748-0f9f-47db-a5f9-56fafcbf2144 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.045920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c04748-0f9f-47db-a5f9-56fafcbf2144 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.045993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c04748-0f9f-47db-a5f9-56fafcbf2144 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.047543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 245/481] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:49.058542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164417-7a3b-43e6-9caa-3afb9b2700e0 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.059001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164417-7a3b-43e6-9caa-3afb9b2700e0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.059205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164417-7a3b-43e6-9caa-3afb9b2700e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.102022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ad164417-7a3b-43e6-9caa-3afb9b2700e0 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:49.103262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ad164417-7a3b-43e6-9caa-3afb9b2700e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:49.191574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 237/482] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:49.304063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f08e-528d-4025-be31-b7f3b84bfe5a None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.304372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f08e-528d-4025-be31-b7f3b84bfe5a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.304554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f08e-528d-4025-be31-b7f3b84bfe5a None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.306142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 246/483] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:49.311589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a409-b42b-4a77-a7d8-13cb264b68f7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.311881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a409-b42b-4a77-a7d8-13cb264b68f7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.312162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a409-b42b-4a77-a7d8-13cb264b68f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.337987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8e01a409-b42b-4a77-a7d8-13cb264b68f7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:49.339199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8e01a409-b42b-4a77-a7d8-13cb264b68f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:49.411306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 238/484] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:49.585873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4f08e-528d-4025-be31-b7f3b84bfe5a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:49.639043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b2709-747a-4f44-9a94-e529b0f4dfd9 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.639348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b2709-747a-4f44-9a94-e529b0f4dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.639608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b2709-747a-4f44-9a94-e529b0f4dfd9 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.641721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 239/485] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:49.648782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.649108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.649676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.689499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:49.690720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:49.705293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:49.750319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4f08e-528d-4025-be31-b7f3b84bfe5a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:49.786836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:49.788168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.788515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.789006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.790714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 240/486] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:49.791852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:49.799678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:49.805351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:49.812691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 247/487] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:49.813520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:49.841184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:49.905434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b074b-68e2-4bfd-95ff-592b6d95d964 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:49.950984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:49.952701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:49.953232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:49.954445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:49.976417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:49.983649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:49.984511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:49.985332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:49.992043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6642b-5399-4a18-9795-a0938231bc5e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:49.995436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 241/488] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:50.006517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.010200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.081939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.083126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.083551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.083962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.088632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:50.089154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.090675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.107163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 248/489] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:50.113982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.178811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f70fea-6a03-458c-a1b2-012def04475f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.217469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.218089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.218375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.218653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.219331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:50.219692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.221700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.235055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.235943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 242/490] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:54:50.237305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.248576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5e89c-a777-440a-94f6-1f90cf77e329 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.291455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.291455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.291455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.291455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.305540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.307165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:50.323134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:50.324292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:50.325241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:50.325241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:50.325241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:50.328131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.329471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 249/491] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:50.330501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.374468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49f0f-0948-483b-93c0-86fd2b83350e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.415201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.415844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.416129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.416412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.434143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:50.441899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:50.442818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:50.443758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:50.446408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 243/492] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:50.447371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.473581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa6a36-e595-4d48-be98-38d040de5722 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.522352 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.523005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.523293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.523785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.533773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.536202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.539343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:50.556222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:50.557226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:50.558145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:50.558145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:50.558145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:50.558145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 250/493] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:50.558145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.574992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e0f65-a335-4af3-afee-c4533a0676f8 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.599426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.611831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.612440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.612725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.613034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.613690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:50.613998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.615470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4acd-91dd-47c2-8b56-017330236309 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.628050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 244/494] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:50.629217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1ac6-2ef3-468e-b5d0-6bc28b2d1766 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.629511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1ac6-2ef3-468e-b5d0-6bc28b2d1766 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.629795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1ac6-2ef3-468e-b5d0-6bc28b2d1766 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.631114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 245/495] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:50.631983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1ac6-2ef3-468e-b5d0-6bc28b2d1766 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.671603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ceec4-0f8e-40ef-85cb-a29cd6436db9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.705325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.705939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.706222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.706506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.707170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:50.707484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.708865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb03019-3b3e-4fcc-b53b-0b82a8dae708 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.718117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 251/496] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:50.719339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37433aca-69cc-4fea-9766-9ee4c857f8a4 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.719632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37433aca-69cc-4fea-9766-9ee4c857f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.719916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37433aca-69cc-4fea-9766-9ee4c857f8a4 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.721141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 252/497] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:50.721898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37433aca-69cc-4fea-9766-9ee4c857f8a4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.738843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1ac6-2ef3-468e-b5d0-6bc28b2d1766 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.773399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.774000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.774284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.774563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.775206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:50.775515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.776891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283ef3f-d0fd-47bd-83e7-64df42919eb6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.782036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.793119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 246/498] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:50.793119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81194-ec14-4553-a147-9cee3ac944a7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.793119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81194-ec14-4553-a147-9cee3ac944a7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.793119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81194-ec14-4553-a147-9cee3ac944a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.809518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c2d81194-ec14-4553-a147-9cee3ac944a7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:50.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c2d81194-ec14-4553-a147-9cee3ac944a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:50.834701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37433aca-69cc-4fea-9766-9ee4c857f8a4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:50.851561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:50.868999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:50.869641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.869933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.870214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.877828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:50.878280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 247/499] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:50.879271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:50.879384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:50.879597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:50.879883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:50.895933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:50.897705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:50.898613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 253/500] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:50.899187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:50.908540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:50.910000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:50.986223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 248/501] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:50.993149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.016742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961ab5f-958b-47d8-9179-42d74f4eca2a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.035183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.056148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.056900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.057293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.057641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.070792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.072360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:51.088025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:51.089430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:51.091237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:51.091237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:51.091237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:51.091237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 254/502] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:51.091237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.126533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ece1-e5b6-4380-bf7f-24aa74e64693 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.129311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.164761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.165895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.166712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.167253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.175613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.177122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:51.192828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:51.195210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 249/503] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:51.196560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.211707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441526-ac5d-4946-8802-9019c7bca377 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.248070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.248684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.249029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.249263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.249994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:51.250302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.251722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.295324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 255/504] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:51.295324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.307250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd8683-2bfe-4076-a131-b47003257619 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.317637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.347687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.348295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.348581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.348860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.349540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:51.349902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.351286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.363942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 250/505] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:51.364990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.390999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.426732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ad6a-0e0b-4132-a059-2a86f93b4845 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.467903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.468547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.468830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.469140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.473191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed08f0-554a-4218-abfd-b21d8f99c96c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.481513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:51.486369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:51.487401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 256/506] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:51.488343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.513399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.514064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.514345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.514621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.515373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:51.515684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.517169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.557517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 251/507] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:51.558177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.578477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.594913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31212b-a4b9-45e8-9e1c-332fe127b576 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.631110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.631982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.632336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.632618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.642327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.642669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.644139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:51.660038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:51.661024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:51.661879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:51.661879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:51.661879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:51.662038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53b436-53c7-4798-9108-9bc5a89fb35e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.662107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 257/508] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:51.662107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.700923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.701575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.701864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.704029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.776300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.777863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.791772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5731-9fd7-49ea-aed8-0092da7e7876 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.826670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.827343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.827628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.827905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.830594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.835790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.837268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:51.850275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:51.851360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:51.852257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 258/509] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:51.852824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.860608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:51.880252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 252/510] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:51.881780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:51.957180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d22aa3-0906-41a2-8e23-a841827c2e64 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.980723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e26d7-9d21-4fe6-a9a5-33ad5cad7f02 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:51.991860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:51.992475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:51.992761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:51.993120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:51.993754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:51.994062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:51.995434 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.003476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 259/511] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:52.004323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.014763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.015373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.015657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.015938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.066188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.074555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.098137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.099632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.110590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb457-7eab-48c2-abfd-2107a1d45df7 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.146582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.147777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.148064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.148347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.149042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:52.149349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.150730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.162946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 260/512] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:52.163491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.212567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 253/513] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:52.213370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.267022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3205b0a-e842-4b61-b616-63b103c8271d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.285624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.297793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.303996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.304617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.304903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.305211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.305943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:52.306254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.307691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.316789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaddd3-6632-4f74-bdc7-8d292f59eaf3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.325430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 261/514] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:52.326242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.352888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.353555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.353844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.354126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.363945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.365514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:52.380646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:52.382053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:52.382922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:52.382922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:52.382922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:52.382922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 254/515] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:52.389104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.433960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8a5a-2e71-4886-8cc5-5e18950b2dd1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.469411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.469962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.470255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.470532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.481302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.482786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.491457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19563022-99dd-4f99-9c08-6978e0196c3b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:52.497978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:52.499107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:52.500135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:52.500135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:52.500135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:52.500135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 262/516] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:52.500559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.531904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.532510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.532796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.533084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.533216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.533744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.535206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.543520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.604894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa6db-3cb3-4c10-8286-c25967f2bd92 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.639255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.639886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.640172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.640451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.650905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.652403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.673301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 255/517] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:54:52 2022] POST /identity/v3/users => generated 247 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:54:52.673301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:52.675090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:52.676135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:52.677217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:52.677217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:52.677217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:52.677217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 263/518] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:52.677217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.771185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.794819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c79d5-3ace-42ec-9363-b1bb79518015 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.808050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58881b-6ec1-44d9-8611-93f5556c61fa None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:52.840845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.841490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.841774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.842051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.842698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:52.843007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.844373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.853069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:52.853921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:52.854361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:52.854639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:52.858383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 264/519] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:52.859657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:52.924105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:52.936043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:52.937899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:52.976916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce681-b45b-4d71-ae9f-7d1d3292ac72 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.014038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.014750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.015108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.015464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.016194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.016577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.018084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.027644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.035796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 265/520] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.036799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.049366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 256/521] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:53.055110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.146710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6284-7d61-44d6-b074-d2d096629182 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.151850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.161978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6d53-b448-4353-ab6e-bbc66271dc37 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.185965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.186668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.187022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.187393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.188118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.188813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.190822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.201874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.202781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.203139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 266/522] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.203440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.203883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.204008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.213266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.215450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:54:53.229902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:53.230977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:53.231974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 257/523] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:53.232462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.276336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.321858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2457c2-3577-4f42-ab6b-9e8985720b8a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.345557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fe268-b9c8-4752-a947-8b7804263ccd None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.360487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.361171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.361458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.361736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.370624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.372080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.381725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.382422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.382768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.383109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:53.384473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:53.385558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:53.386463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 267/524] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:53.387010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.398683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.400252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:53.416442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:53.417668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:53.418511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:53.418511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:53.418511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:53.418511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 258/525] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:53.418511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.422051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.520673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485637-a8c7-4457-9db4-e90882003cbb None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.535985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e89d3-c408-46aa-be7b-c641f8c7bdb3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.545565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.565896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.566903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.567370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.567823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.572352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.573271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.573271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.573907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.574674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.574674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.575838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.578314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.579762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:54:53.593043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:53.594579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 268/526] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:53.596445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.607053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 259/527] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.607053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.673408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.714085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc78f9c-d94a-490e-87a8-9bc9baade865 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.719040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1212-04ca-4ffb-a7a3-a509d812d4fa None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.751183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.751894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.752188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.752468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.753236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.753551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.754981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.755887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.757204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.757833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.758464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.759166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.759481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.761048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.778951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 269/528] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.778951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.779191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 260/529] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.779191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.823853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.888429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04cf1-922b-46f5-81ba-5c64f9f8b3e4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.895736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc718018-8305-4df8-83ca-6ba9934ad9b6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:53.920602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:53.925477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.926094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.926380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.926668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.927366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.927778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.929425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.934076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:53.935041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:53.935502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:53.935954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:53.936898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=e3083107d17b4596b7b858df7fc50147) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:53.937423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:53.939503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:53.952982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 270/530] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.952982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:53.953728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 261/531] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/role_assignments?user.id=e3083107d17b4596b7b858df7fc50147&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:53.954873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:54.090886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:54.096033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2de846-dac4-4922-b592-23cdd56e97c0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.106950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127402a9-da35-452c-b211-e24a6bd0b0ed None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.151536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.152232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.152560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.152855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.156677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.157596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.158174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.158661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.160901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.163301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:54:54.180567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:54.181505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:54.182338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:54.183267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:54.223988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:54.238092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.239777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.319908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0d025-6c4b-4b70-bb30-573d255b6c67 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.353288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 262/533] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:54.354391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:54.375002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.376310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.376770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.377268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.378232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7f1fb138bb984445a9187f782b47589c) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:54.379243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.382053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.390904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 272/534] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:54 2022] GET /identity/v3/role_assignments?user.id=7f1fb138bb984445a9187f782b47589c&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:54.392090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:54.431811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:54.529541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:54.550662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ea08-f7e3-4eb1-907a-60bf2a98aa5d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.585537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d77260-a858-4dc2-8442-faed06a7e39e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.595124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.595735 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.596019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.596296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.597177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:54.597490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.598938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.613024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 263/535] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:54.619198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:54.657301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.657956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.658241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.658523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.678638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.680597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:54.713274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:54.714412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:54.715428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:54.715428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:54.715428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:54.724965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 273/536] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:54.726133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:54.764960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a117586-1ae0-4192-a2f1-3d9260c962c8 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.818817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.820159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.822098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.822098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.822341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=37d12b58ffac40e8a90d32748f470a61) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:54.822585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.824107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbc1b2-934e-48e6-a982-08b7d1efbe90 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.832381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 264/537] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:54 2022] GET /identity/v3/role_assignments?user.id=37d12b58ffac40e8a90d32748f470a61&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:54.840617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b315-db44-4b4d-9ffa-b9c6b68ddb3b None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.840899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b315-db44-4b4d-9ffa-b9c6b68ddb3b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.841213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b315-db44-4b4d-9ffa-b9c6b68ddb3b None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.843048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 265/538] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:54.847687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:54.852239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.852531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.852819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.883222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85f526-d2cb-4618-ba5b-35290428b87a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:54.929173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:54.931907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:54.932205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:54.932486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:54.933202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:54.933515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:54.934957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:54.937812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:54.939625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:54.948623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:54.948810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 274/539] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:54.953749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:55.076310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 266/540] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:54:55.132205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380d22d-dea3-4e9b-8b47-02e4f2f490f8 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:55.213963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:55.214583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:55.214830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:55.215110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:55.217609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:55.226794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:55.228284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:54:55.250482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:55.251657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:55.252721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 275/541] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:54:55.258909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:55.399860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b422891-1430-4f2e-9496-e4b282a36c61 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:55.444754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:55.445406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:55.445694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:55.445979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:55.446686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:55.446997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:55.448469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:55.457615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:55.461674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 267/542] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:55.467686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:55.588763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:55.631053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a7e8-1b7d-4207-bb9f-b87ee520c9c4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:55.675818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:55.676535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:55.676825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:55.677129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:55.678496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=36a39e19ba8648ceb28c67d22c00e3fb) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:55.678817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:55.680376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:55.696021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 276/543] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:55 2022] GET /identity/v3/role_assignments?user.id=36a39e19ba8648ceb28c67d22c00e3fb&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:55.762985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce1bf5-dc2d-4bdc-8149-db4e4838b632 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:55.801069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:55.801726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:55.802012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:55.802294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:55.815056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:55.821016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:55.821896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:55.822669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 268/544] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:55.828593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:55.927413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:55.986820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0201960-bf51-436d-8652-5cb14fdac8a3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.027723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:56.028271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.028558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.028837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.029563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:56.029874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:56.031253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:56.044366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 277/545] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:56.049624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.128175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:56.180839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb53f-ed46-4183-a619-da17617afb17 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.229343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:56.229989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.230273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.230552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.242656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:56.244215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e4ebfe67-d214-49c5-b975-779a043a692c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:56.264680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:56.266154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:56.266998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:56.266998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:56.266998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:56.270258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 269/546] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:56.276574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.288669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc3b7-6dd6-4955-b5d8-ac8743253546 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.290778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc3b7-6dd6-4955-b5d8-ac8743253546 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.290778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc3b7-6dd6-4955-b5d8-ac8743253546 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.290778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 270/547] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:54:56.295741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.296037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.296317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.330246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:56.331467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:56.416292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 271/548] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:56.441120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111441b4-6409-442c-b83c-17ba1fc5af87 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.462247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:56.483992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:56.484732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.485038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.485317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.486085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:56.486392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:56.487761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:56.511012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 278/549] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:56.512303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.594592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:56.656875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413c169-abe5-4b14-9411-538c51e21d96 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.700545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:56.701675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.702162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.702647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.711488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:56.713306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:56.730507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:56.731453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:54:56.732366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:56.734883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 272/550] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:56.744072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.830686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.883969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a981ce-291b-42ac-af27-a677ee0ee319 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.919341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:56.920529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.920529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.920529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.921335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:56.921641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:56.923076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9af1bf-e8ae-47f0-b003-98a4adb691d4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:56.948335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 279/551] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:56.948335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb285c-d018-4a13-a80a-31a67193738e None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:56.948335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb285c-d018-4a13-a80a-31a67193738e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:56.948335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb285c-d018-4a13-a80a-31a67193738e None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:56.948335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 280/552] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:56.954200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb285c-d018-4a13-a80a-31a67193738e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:56.964839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316617c-bd03-44c6-a071-6fde66e82883 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:56.966454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.009937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.012817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9249-d4a6-4482-a292-9b3b4ea6b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.013987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9249-d4a6-4482-a292-9b3b4ea6b554 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.014351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9249-d4a6-4482-a292-9b3b4ea6b554 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.014699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9249-d4a6-4482-a292-9b3b4ea6b554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.028824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9249-d4a6-4482-a292-9b3b4ea6b554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-a1bf9249-d4a6-4482-a292-9b3b4ea6b554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:57.036334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:57.037828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:57.038696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:57.041028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 273/553] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:57.042443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.042909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.043349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.064819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:57.066397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:57.089857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb285c-d018-4a13-a80a-31a67193738e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.133553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3616fb-e30c-4097-96fd-2413ec100c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.134385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3616fb-e30c-4097-96fd-2413ec100c16 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.134613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3616fb-e30c-4097-96fd-2413ec100c16 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.134886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3616fb-e30c-4097-96fd-2413ec100c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.147039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 274/554] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:57.148029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.230472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3616fb-e30c-4097-96fd-2413ec100c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:57.232332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3616fb-e30c-4097-96fd-2413ec100c16 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:57.255235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.267515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee576a5-aaac-44d2-947d-8bb2dadec954 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.275883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.314031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.314985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.315450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.315930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.316793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:57.317734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:57.319958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11830c2-db4a-4edb-832d-3ed210c44b6f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:57.331197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 275/555] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:57.332677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e8e3-5d08-4f1c-a732-d178535170da None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.333158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e8e3-5d08-4f1c-a732-d178535170da None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.333629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e8e3-5d08-4f1c-a732-d178535170da None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.335437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 276/556] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:57.337420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e8e3-5d08-4f1c-a732-d178535170da None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.352987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 281/557] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:54:57.352987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.352987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.353642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.373002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:57.374371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:57.463390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 282/558] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:57.464250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.472803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e8e3-5d08-4f1c-a732-d178535170da None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.524758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.526022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.526621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.527070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.539899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:57.541862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:57.554916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:57.561854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:57.562790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:57.563981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:57.563981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:57.563981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:57.566014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 277/559] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:57.567012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.578056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.597120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5993f-9cc6-4597-a027-f66c0e7a6923 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.645369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.646022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.646890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.647305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.664322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:57.666869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:57.689052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:57.690045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:57.690896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:57.690896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:57.690896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:57.693075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 283/560] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:57.694730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.697825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c55e9a-ee47-47b3-870b-3b7bc4324f1e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.744177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.745292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.745779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.746252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.760562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:57.765941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:57.766941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:57.767792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 278/561] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:57.769271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.823956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af4121-a0d1-405b-8ec3-a17c2322a2a9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.847582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.861846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.862464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.862756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.863037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.863695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:57.864006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:57.864693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:57.865511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:57.878869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 284/562] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:57.879751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.915470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae233a-688a-4d22-8042-dc7a00f86d2e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:57.954116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:57.954757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:57.955045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:57.955324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:57.955968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:57.956279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:57.957711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:57.970737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 279/563] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:57.971561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:57.997315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51c41-6f8c-452d-b162-642e14e35e9c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.036358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.037995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.038436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.038866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.049696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:58.055221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:58.056158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:58.057296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 285/564] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:58.061989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.083303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689ab8-e0cc-4341-afd4-fccb06007b29 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.105220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.110410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.119622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.120239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.120530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.120846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.121536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:58.121843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.123267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.131432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 280/565] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:58.132441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.165425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb6bd7-b65a-4d68-aed4-759434f882a5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.200846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.201536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.201828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.202106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] PATH_INFO: `/v3/users/nova` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.210259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.211709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:58.223509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:58.225147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:54:58.226076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:58.229083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 286/566] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:58.230230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.240037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0f7d-ee5e-4054-a80c-49f36063337a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.275602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.276285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.276516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.276797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.283470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.284958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-98fdbe17-3614-41cd-9a9b-bee6ecc7f637 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:54:58.297328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:58.298225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 281/567] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:58.299713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3298f1-44be-4ebc-b7f7-4cefdaaa18af None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.300355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3298f1-44be-4ebc-b7f7-4cefdaaa18af None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.300355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3298f1-44be-4ebc-b7f7-4cefdaaa18af None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.301628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 282/568] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:54:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:54:58.302118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3298f1-44be-4ebc-b7f7-4cefdaaa18af None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.340883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.343721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f55c3-7a1e-4e05-8c03-ed4c7079a35f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.357950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.379802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.380474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.380784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.381116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.381798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:58.382105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.383472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.391675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 287/569] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:58.392413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.411283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3298f1-44be-4ebc-b7f7-4cefdaaa18af None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.448629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.449298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.449580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.449855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.460657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.462165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:58.477018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:58.478054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:58.478950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:58.478950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:58.478950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:58.478950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 283/570] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:58.478950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.495171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078edf1-7b01-4d10-b6f2-d655ce87a5c1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.534295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.534841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.535127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.535415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.536152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:58.536464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.538111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c623e-bb42-4714-ad5a-fedd9821f721 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.555420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 288/571] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:58.556977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.557274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.557559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.576177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:54:58.577446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:54:58.586003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.589282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11886ae-9146-40ea-9658-8726f01ba4b1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.592018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.621707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.622315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.622602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.623267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.624276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:58.625103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.626573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.639096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 284/572] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:58.639904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.644688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 289/573] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:54:58.645572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.752579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d55695-7307-4436-bfd6-5e42a2b0ca3c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.754109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019bbb8-a926-4e3c-923e-10b208223f08 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.792201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.792749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.793092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.793387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.799138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.799752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.800038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.800317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.801039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:58.801348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.802913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.806446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.808142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.820973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 290/574] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:58.820973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:58.825570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:58.826626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:58.827591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:58.827591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:58.827591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:58.827591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 285/575] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:58.828332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.837376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.846001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:58.929829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f14f-3c20-44ba-8b24-6e6992a12596 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.937656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606f013-03ad-4196-8b60-3769d1fdb6f8 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:58.962703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.963333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.963621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.963897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.971687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:58.972302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:58.972586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:58.972884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:58.973653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=4d48d9e6668b4866a21c2e0361fd3b88) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:58.973964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.974204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:58.975869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.976042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:58.981419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 286/576] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/role_assignments?user.id=4d48d9e6668b4866a21c2e0361fd3b88&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:58.987645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:58.997082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:58.998123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:58.998996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:58.998996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:58.998996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:58.998996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 291/577] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:58.999238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.100797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5cb8-fa49-4b3b-9145-578dcd4685b0 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.112777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cf932-ba70-44f7-aac1-595f468ab608 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.136399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.137164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.137450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.137729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] PATH_INFO: `/v3/users/glance` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.145859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.148195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.151796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.152497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.152861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.153177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.153835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:59.155311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.156576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:59.160835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:59.162501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:54:59.163499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:59.167393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 287/578] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:59.168060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.174341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 292/579] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:59.174341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.182816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.218774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.321606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd907-7b45-4b4d-93fd-9675f73a7685 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.324240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8cc6d-afff-493d-b53b-89d7c03e8deb None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.346168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.360213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.360845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.361189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.361470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.361959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.362150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:59.362426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.362602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.362890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.363170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.363851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.366837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.376513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 293/580] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:59.376714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:54:59.377810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:54:59.382313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:59.388910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 288/581] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:59.389865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.493410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755817f-f3ca-49f0-a8a1-cb61e1c66bfa None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.502822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549b11-ed32-44e4-9e07-2b36f723aae5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.536337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.537787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.538271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.538738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.540400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:59.540400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.543463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.546661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.547711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.548211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.548696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.557738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.559652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.571809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 294/582] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:54:59.572592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:59.573572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:59.574490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 289/583] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:59.575084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.576086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.626527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.635616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.681464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151b5e3-b61f-49f7-9345-28a9378d5fea None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.694914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383ddc4-11e8-450e-98e2-a16548e367be None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.718695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.719307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.719591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.719866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.720528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:59.720829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.722248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.731285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 290/584] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:59.732065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.737811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.738636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.739130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.739409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.747341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.748808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:54:59.760202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:59.761181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:54:59.762057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 295/585] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:59.762560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.848136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3054cd1-f793-4918-8116-2ac6775cc2d4 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.868636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.869950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:54:59.873911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f550f1-959c-4e56-9e9b-396e581fd47a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:54:59.885418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.885994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.886281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.886565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.897818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.899292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:54:59.915580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:54:59.916877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:54:59.917792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:54:59.917792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:54:59.917792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:54:59.917792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 291/586] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:54:59.917792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:54:59.925190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:54:59.925885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:54:59.926235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:54:59.926960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:54:59.927390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:54:59.927975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:54:59.929474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:54:59.952914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 296/587] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:54:59.952914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.037952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be4c9-d8b8-4791-9f07-694fe4a6e058 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.064300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427920b-e93a-442f-92ba-a8ea73a13a84 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.077026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.077694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.078046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.078334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.090100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.091734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.106257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.106880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.107191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.107477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.108178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:00.108491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:00.108652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:00.109557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:00.110549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:00.110549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:00.110549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:00.110549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 292/588] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:00.111197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.114462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.132319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 297/589] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:00.132319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.147342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.151117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.231184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640e431-2afe-452c-8fce-f2c3f8bbbb70 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.240011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ab36-bda1-46bb-838e-62ecd94038a0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.266886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.267502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.267791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.268069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.268757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:00.269100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.270500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.278666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.279627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.280067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.280500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.282230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 293/590] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:00.283042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.296456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.298227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:00.315848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:00.317016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:00.318128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:00.318128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:00.318128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:00.324183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 298/591] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:00.325185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.372803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.392187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ffdba-6c8e-4e90-b669-a897103a5a27 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.397077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.432641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30cb4b-05dc-43da-a298-6e70d8c5841c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.432850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.432850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.432850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.432850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.433234 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:00.433234 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.434611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.446369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 294/592] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:00.451898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.466074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.466741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.467026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.467308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/e3083107d17b4596b7b858df7fc50147/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.483782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=e3083107d17b4596b7b858df7fc50147, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.485277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.559844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c05e5-f0e2-4f85-9cac-23b6d2abe380 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.567116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 299/593] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:00 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/e3083107d17b4596b7b858df7fc50147/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:00.578073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.604024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.604773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.605110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.605403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.613850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.615431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:00.630033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:00.631202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:00.632302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:00.636477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 295/594] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:00.637522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.640751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.731044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba613-c900-4894-b7d3-dbc0e1257395 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.755546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.768741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3119-9a4c-4662-936a-21f9416678a9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.773739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.774681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.775199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.775695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.777111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:00.777634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.779630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.796601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 300/595] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:00.797744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.810806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.811701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.811995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.812372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.821749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.823365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:00.836239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:00.837471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:55:00.838629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:00.845108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 296/596] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:00.845108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.911312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:00.929571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc69be-1934-4d0a-ac99-c8c1fd2139d3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.954292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb458-d318-4330-903e-63c11ec4f135 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:00.968549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.969631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.970115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.970391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:00.971176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:00.971483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:00.972915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:00.985383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 301/597] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:00.986123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:00.993652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:00.994297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:00.994583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:00.994859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.002014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:01.003662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-aef6af20-fd2f-42a4-8043-af379d1a4f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:01.017930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:01.018928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:01.019803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 297/598] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:01.020750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5650-7790-4749-99c3-bff23c3ccfa6 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.020750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5650-7790-4749-99c3-bff23c3ccfa6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.020923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5650-7790-4749-99c3-bff23c3ccfa6 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.023287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 298/599] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:01.023996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5650-7790-4749-99c3-bff23c3ccfa6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:01.043536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:01.103653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0729b7-85ae-424d-9227-a3c10c60d605 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:01.135796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5650-7790-4749-99c3-bff23c3ccfa6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:01.142501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:01.143619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.143902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.144171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.145293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:01.145611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:01.148085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157b361-bfc0-4be7-9bf3-8df42edc77b6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:01.160895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:01.170890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 302/600] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 30 00:55:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:01.172534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.173086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.173573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.182657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:01.183331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.183600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.183874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7f1fb138bb984445a9187f782b47589c/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.205327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:01.207269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:01.208243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=7f1fb138bb984445a9187f782b47589c, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:01.209737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:01.279368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 303/601] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:01.280229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:01.317158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:01.375805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 299/602] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:01 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7f1fb138bb984445a9187f782b47589c/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:01.375805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:01.430887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d634e6-6ebf-4cee-98e4-cbb970088d36 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:01.504779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:01.507181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.508360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.508997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.510249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:01.510665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:01.513529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:01.548556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 304/603] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:01.553571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:01.576634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9566-d125-439d-bf62-30167bcd7fd3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:01.633984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:01.634638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.634928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.635204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.652618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:01.654443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:01.674103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:01.679080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:01.680166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:01.681303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:01.681303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:01.681303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:01.683765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 300/604] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:01.684851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:01.694214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a33af-de67-487e-a1f2-888872f6a11a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:01.719015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:01.734643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:01.735666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.736147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.736673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/37d12b58ffac40e8a90d32748f470a61/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.756836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=37d12b58ffac40e8a90d32748f470a61, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:01.758893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:01.810502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1626-00cf-450a-a7dc-d0052696070a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:01.846867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:01.847498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:01.852979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:01.852979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:01.859271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:01.864571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:01.866257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:01.867079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 301/605] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:01.867772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:01.881184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 305/606] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:01 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/37d12b58ffac40e8a90d32748f470a61/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:55:01.885184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.008301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.031211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139637f-af21-41ea-97ef-02938a32928f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.098693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7443b-e515-4aea-9f18-4d270eceb0df None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.120639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.121283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.121570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.121846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.122506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:02.122810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.124203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.141053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 302/607] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:02.149065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.157441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.158424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.159038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.159524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.160412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:02.160968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.163290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.174140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.177297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 306/608] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:02.180423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.319976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07695c7-341e-4be6-bb6e-c13302c7d76c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.339444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec278c23-11df-4c04-855a-2076e3884679 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.364095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.364808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.365685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.366294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.375133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.376604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.377769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.378634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.379111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.379497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:02.389379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:02.390292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:02.391413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 303/609] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:02.402643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.402825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.404126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.408010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:02.433558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:02.435169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:02.437221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:02.437221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:02.437221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:02.441236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 307/610] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:02.444316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.545328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.604395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1a1b-d432-43ab-9ca9-262ab6d0decd None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.641237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f229f-e03e-444d-b6e7-a27714b3ac83 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.673784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.674501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.674927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.675344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.676282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:02.676725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.678663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f87da2-a591-49c7-be4e-596b64f75b2a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.693620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 304/611] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:02.694923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb06ce-ba1e-49a8-a5f6-02371cd0e7ea None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.695214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb06ce-ba1e-49a8-a5f6-02371cd0e7ea None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.695493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb06ce-ba1e-49a8-a5f6-02371cd0e7ea None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.697000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 305/612] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:02.704579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb06ce-ba1e-49a8-a5f6-02371cd0e7ea None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.704781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.704781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.704781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.704781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.705425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:02.705425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.706654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496615b-e288-439c-a35d-d41b37246304 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.720697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 308/613] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:02.722011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.722305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.722590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.743784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:02.745040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:02.771682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.813911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb06ce-ba1e-49a8-a5f6-02371cd0e7ea None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.819088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 309/614] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:02.819978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:02.854528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.855507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.855952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.856392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/36a39e19ba8648ceb28c67d22c00e3fb/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.870221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:02.874175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=36a39e19ba8648ceb28c67d22c00e3fb, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.875951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.938734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af8845-8489-49ea-a2f9-f4d3dd8a38c9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:02.975410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:02.976053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:02.976340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:02.976623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:02.977252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 306/615] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:02 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/36a39e19ba8648ceb28c67d22c00e3fb/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:02.984782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:02.986315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:02.999391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:03.000408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:03.001384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 310/616] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:03.007058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.171735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.189141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f908a-a47c-4cbe-bc50-7298de467bd7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:03.221323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:03.286397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:03.288424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.288925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.289465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.290848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:03.291407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:03.294190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:03.317626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 307/617] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:03.324504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.352603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5ec3c-cde4-495d-a5ce-70f7f86348e9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:03.355043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:03.404004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:03.405593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.406424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.406952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.423457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:03.430671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:03.431825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:03.432693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:03.435515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 311/618] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:03.444795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.457822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e31ad-18e2-40e2-931d-f169eb8bfcb9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:03.528640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:03.529324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.529606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.529883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.546957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:03.548440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:03.589962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:03.591792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:03.593561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:03.593561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:03.593561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:03.593561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 308/619] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:03.605188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350151c-58a8-42db-ab09-65138b288288 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:03.605956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.643174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:03.643794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.644074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.644348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.645048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:03.645495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:03.647603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:03.656354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:03.665657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.670709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:03.717074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:03.750590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51363a4f-e371-46e9-8e85-91a84d39e511 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:03.809228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:03.809859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.810158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.810450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.811113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:03.811429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:03.812827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:03.831715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:03.839638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.870028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d8303-4479-4580-bf8e-478d3d5034a4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:03.917969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:03.918629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.918915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.919200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.933193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:03.934964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-2af6a2cf-ec11-4571-b569-6afdca913194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:03.961122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:03.962311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:03.963395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:03.963395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:03.963395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:03.963395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 313/622] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:03.964640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dac00-db6b-4501-8fb4-7ae0a94ba5c1 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:03.968311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dac00-db6b-4501-8fb4-7ae0a94ba5c1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:03.968311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dac00-db6b-4501-8fb4-7ae0a94ba5c1 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:03.969051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 314/623] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:03.973781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dac00-db6b-4501-8fb4-7ae0a94ba5c1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:03.984048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.016783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d92f9-9e54-4473-9fd4-176869f1da7e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.070603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.071259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.071549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.071832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.072576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.082180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.084228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.100905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dac00-db6b-4501-8fb4-7ae0a94ba5c1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-84cfc676-a192-45f5-a93e-0f884b8b62b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:04.101333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:04.102241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:04.103482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 310/624] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:04.104131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.104423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.104712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.128901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:04.130498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:04.144453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.145492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.145951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.146965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.147843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:04.148446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.150245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.172587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 315/625] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:04.174324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.229279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 311/626] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:04.230639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.306025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ee79d-42a2-413a-a8d0-fa7fe0388a34 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.347802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.348483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.348773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.349133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.350082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:04.350400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.351856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.354877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.367153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 316/627] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:04.373141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.446157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.498407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cfcb6-567c-4f23-81ee-42d997c4b651 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.500066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e3f12-5c01-438b-bbac-fd0db100317e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.546151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.547077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.547496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.547903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] PATH_INFO: `/v3/users/nova` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.553773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.554559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.554946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.555322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/4d48d9e6668b4866a21c2e0361fd3b88/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.559635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.561965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.572893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=4d48d9e6668b4866a21c2e0361fd3b88, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.575011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3a080f95-41ef-4879-b4fe-141eaf46aceb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:04.581166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:04.582239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:04.583177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 312/628] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:04.585384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e343-69d6-4dd2-8cc8-bc79c1a762f9 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.592315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e343-69d6-4dd2-8cc8-bc79c1a762f9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.592315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e343-69d6-4dd2-8cc8-bc79c1a762f9 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.592315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 313/629] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:04.592315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e343-69d6-4dd2-8cc8-bc79c1a762f9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.663995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 317/630] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:04 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/4d48d9e6668b4866a21c2e0361fd3b88/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:55:04.665081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.710865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e343-69d6-4dd2-8cc8-bc79c1a762f9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.736589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.763953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444fc22-9c42-4fe6-bb88-39dd8ab1eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.764881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444fc22-9c42-4fe6-bb88-39dd8ab1eedd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.765470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444fc22-9c42-4fe6-bb88-39dd8ab1eedd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.765829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444fc22-9c42-4fe6-bb88-39dd8ab1eedd None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.769278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:04.785070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444fc22-9c42-4fe6-bb88-39dd8ab1eedd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-a444fc22-9c42-4fe6-bb88-39dd8ab1eedd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:04.790754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:04.791774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:04.792605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:04.796746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 314/631] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:04.798689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.799230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.799682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.818846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75faa2-cc1b-4547-807b-4a2d734f7ffa None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:04.822246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:04.823656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:04.870411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:04.871042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:04.871329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:04.871611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:04.872376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:04.872690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:04.874948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:04.902484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 318/632] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:04.906069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:04.918928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 315/633] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:04.920007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.082732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675b174-b3d2-4754-be26-20a35be88b8c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.120981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.120981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.120981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.120981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.121431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.140438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d22fd-afb1-433e-8b89-a98d64e4b695 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.143311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.215260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:05.216753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:05.221956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.222736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.223028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.223309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.223990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:05.224996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:05.226365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:05.244959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 319/634] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:05.260432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.339975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 316/635] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:05.340759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.378287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.439905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee37f3-f636-4b94-a4a8-8a9be62748d0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.463486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8abc9-2747-4e0a-a84d-54a3cfbd903c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.484419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.485084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.485367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.485643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.498051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:05.499502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:05.504069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb3e4-1f04-4dd5-b5d6-9af4bb48fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.504711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb3e4-1f04-4dd5-b5d6-9af4bb48fe38 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.505021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb3e4-1f04-4dd5-b5d6-9af4bb48fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.505335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb3e4-1f04-4dd5-b5d6-9af4bb48fe38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:05.517146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:05.518019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:05.518898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:05.518898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:05.518898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:05.523211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 320/636] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:05.524110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.530728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdb3e4-1f04-4dd5-b5d6-9af4bb48fe38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e2cdb3e4-1f04-4dd5-b5d6-9af4bb48fe38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:05.539432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:05.540396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:05.541264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 317/637] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:05.541966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6ef3-560f-436d-8bfc-2f4a654a0ca9 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.542531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6ef3-560f-436d-8bfc-2f4a654a0ca9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.542531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6ef3-560f-436d-8bfc-2f4a654a0ca9 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.543832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 318/638] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:05.548382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6ef3-560f-436d-8bfc-2f4a654a0ca9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.551113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.651926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664fbe9-5e5d-4209-a315-7a0744266a22 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.653009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.671151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6ef3-560f-436d-8bfc-2f4a654a0ca9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.692204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.692959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.693809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.694215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.707041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:05.709995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:05.710991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.711608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.711896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.712180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.712836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:05.713183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:05.714572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a721b0-fb25-4280-8947-d44965e2e024 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:05.727133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:05.728107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:05.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:05.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:05.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:05.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 321/639] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:05.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.740902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 319/640] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:05.740902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.740902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.740902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.760193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:05.761515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:05.817085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.848473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 320/641] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:05.849810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.868839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e8069-645d-42a4-be0c-4bdd69bce6c3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:05.919168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:05.919697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:05.919986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:05.920269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:05.921284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:05.921604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:05.923287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:05.939646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 322/642] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:05.939646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:05.954117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:05.985877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5e2a-12af-4905-8027-fc138cdb3e71 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.034727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.035351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.035635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.035912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.036654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:06.037088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.038471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.055328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 321/643] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:06.056294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.077314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960193c-8896-438e-b905-af839b1c7151 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.111790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:06.118527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.119547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.126689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.126689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] PATH_INFO: `/v3/users/glance` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.129557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.131876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:06.144864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:06.146706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:55:06.147802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:06.150528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 323/644] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:06.151858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.164375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34435dda-97e1-448c-8756-f707528c8ca2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.202495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.203239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.203362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.203587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.205919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:06.216329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.229747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:06.234047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:06.235009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:06.236044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:06.236044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:06.236044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:06.236044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 322/645] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:06.236044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.279028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a06b-476b-4b84-a841-5259642b2827 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.317274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.318671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.318961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.319258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.326788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.328272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:06.340662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:06.341815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:06.342693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 324/646] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:06.343191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.362857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb65f22-ed91-4690-9196-3a6af2dee936 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.402030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.402649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.402936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.403213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.403953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:06.404263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.405738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.408767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:06.431478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 323/647] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:06.431478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.468368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aad917-9bb7-463d-8a78-b97f332428b7 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.484428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:06.511000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a59250-854b-4747-8408-432b154fda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.511754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a59250-854b-4747-8408-432b154fda34 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.512119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a59250-854b-4747-8408-432b154fda34 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.512401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a59250-854b-4747-8408-432b154fda34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.534204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a59250-854b-4747-8408-432b154fda34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-19a59250-854b-4747-8408-432b154fda34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:06.539702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:06.540669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 325/648] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:06.541919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a59250-854b-4747-8408-432b154fda34 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.556904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef92ef-c8d7-4ef9-8f97-c41e1da3c62d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.606862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.607589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.607834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.608003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.608697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:06.608985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.610402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.627515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 324/649] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:06.627515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.675245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a59250-854b-4747-8408-432b154fda34 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.692065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:06.715461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.716085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.716374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.716652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.717404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:06.717722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.719255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.732693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 326/650] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:06.737884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.753661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9acc3-7eb2-4531-8b86-96afbad2bef4 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.759727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:06.794531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.795153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.795440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.795722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.853589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334837d-95d6-45b3-a3f7-5632e7abea4a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:06.878297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.879813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.893405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:06.894017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:06.894309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:06.894590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:06.895316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:06.895624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:06.897770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:06.905802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 327/651] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:06.906609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:06.946123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.004846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 325/652] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:07.004846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.008367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.020778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309a38b-30a4-4cb4-a405-e47aca8d6f2e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.056505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.057214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.057498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.057774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.066201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.067583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-4c4230f7-2bd6-4d31-99da-25c4ef62b68d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:07.079912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:07.080890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:07.081873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 328/653] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:07.082564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1a8d-b0b3-4962-ada3-f88521bd40f8 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.082564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1a8d-b0b3-4962-ada3-f88521bd40f8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.083232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1a8d-b0b3-4962-ada3-f88521bd40f8 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.088854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 329/654] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:07.089628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1a8d-b0b3-4962-ada3-f88521bd40f8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.112862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f63d-68b7-477c-8ab3-260bc7f89628 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.149039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.149634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.149901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.150182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.150912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=e3083107d17b4596b7b858df7fc50147) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:07.151223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.152719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.158444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 326/655] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/role_assignments?user.id=e3083107d17b4596b7b858df7fc50147&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:07.159231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.192199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.206445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad1a8d-b0b3-4962-ada3-f88521bd40f8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.247645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.262906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.262906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.262906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.262906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.270239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.272119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:07.295120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:07.296584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:07.297710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:07.297710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:07.297710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:07.297710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 330/656] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:07.297710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.306519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3ed9-0538-426c-b3ec-474598d1019b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.362816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.364149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.364149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.364149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.379690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.383213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-a15544eb-cf57-4efe-8f4b-51fdb07a73fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:07.410662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:07.412793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 327/657] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c947c-889e-418b-bc48-1266aa20543f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c947c-889e-418b-bc48-1266aa20543f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.418035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c947c-889e-418b-bc48-1266aa20543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.442758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-324c947c-889e-418b-bc48-1266aa20543f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:07.445366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-324c947c-889e-418b-bc48-1266aa20543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:07.448833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f14bb-cf24-49ba-b8f9-52133f9e7e7d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.489356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.491084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.491460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.491664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.492405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:07.492718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.494188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.518145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 331/658] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:07.519011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.524485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.558985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 328/659] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:07.559872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c947c-889e-418b-bc48-1266aa20543f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.644674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.719021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c947c-889e-418b-bc48-1266aa20543f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.721245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4f27-aee8-4a2a-9485-70533b0c653c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.763705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.764648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.765224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.765762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.767028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:07.767365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.770241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.777198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.778349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.779034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.779629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:07.780965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:07.781713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:07.785864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:07.796968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 329/660] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:07.798541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.805792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 332/661] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:07.807939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:07.904833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.942006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2829e-405c-496b-9ddd-c2606fcf70f5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.952504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8eed3-3c23-4b98-81f5-f38cde31b252 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:07.960344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:07.987648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:07.988461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:07.988820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:07.989103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.013730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.014372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.014668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.015012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.024581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.025994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:08.038239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:08.040596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 333/662] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:08.044396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.089677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.091572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.175024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338034d1-aa00-4a8b-a0c5-613b2dc21625 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.211791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:08.229011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 330/663] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:08.229011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.234739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.235567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.235911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.236252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.243003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:08.247509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.249469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:08.262968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:08.264758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 334/664] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:08.266594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.387055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f7b8-b9f9-411a-954c-6142b66f4748 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.417061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cda71-5b8c-49fc-90b5-f1f5d61b8db3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.436853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.437535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.437820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.438296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.451390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:08.457142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:08.461423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 331/665] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:08.462269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.468909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.469850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.470344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.470842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.471751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:08.472270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.474655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.489023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 335/666] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:08.491008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.555333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:08.601378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdab69e-becf-406e-a95c-8a4802db980b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.640866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.641463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.641751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.642032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.654132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.655626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.664051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:08.676389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:08.678869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:08.679803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:08.679803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:08.679803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:08.679803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 332/667] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:08.679803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.736067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a456-c065-4161-91b4-e475bae66a9a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.772659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.773287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.773567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.773840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.774573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:08.774876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.776296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.796641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 336/668] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:08.797718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fb206-eae3-472b-bd3d-eef9823a4d8e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.801926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.825686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:08.838651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.839257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.839536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.844109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.844109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:08.844109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.844109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.851494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 333/669] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:08.853655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.915622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43456f9a-8eb4-4ff6-b1be-a8b18e38d478 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:08.917072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:08.953120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:08.953741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:08.954027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:08.954308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:08.955063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7f1fb138bb984445a9187f782b47589c) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:08.955358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:08.956876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:08.964444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 337/670] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/role_assignments?user.id=7f1fb138bb984445a9187f782b47589c&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:08.965366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:08.971796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f6b9-6568-4297-a6a0-ab9b002bb1e9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.022795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.024609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.025026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.025405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.032259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:09.032259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.032259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.050937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 334/671] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:09.050937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.117013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.134351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20847-1f1b-48ba-b895-4ecb96553e79 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.184188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6199fcd-8359-4d3a-a880-bfcca2f7930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.184760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6199fcd-8359-4d3a-a880-bfcca2f7930a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.185082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6199fcd-8359-4d3a-a880-bfcca2f7930a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.185359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6199fcd-8359-4d3a-a880-bfcca2f7930a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.197440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b895-6baa-4dee-8b8d-dfb4cfad4d8a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.228484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.243682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.244768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.245080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.245493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:09.312482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:09.313832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 335/672] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:09.315037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.316967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6199fcd-8359-4d3a-a880-bfcca2f7930a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.319754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6199fcd-8359-4d3a-a880-bfcca2f7930a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.433911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.441890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556321f-909a-415c-9caa-2d2fe5faac20 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.460378 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 338/673] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:09.462053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dfcb-e50f-4b40-b288-ab609361ad32 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.462550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dfcb-e50f-4b40-b288-ab609361ad32 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.463065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dfcb-e50f-4b40-b288-ab609361ad32 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.464827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 339/674] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:09.465795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250dfcb-e50f-4b40-b288-ab609361ad32 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.496643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.497432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.497659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.497941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.511754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.515942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:09.531003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:09.531993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:09.532874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:09.538908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 336/675] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:09.538908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.569045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.609697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250dfcb-e50f-4b40-b288-ab609361ad32 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.650392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.651573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.651915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.652197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.652850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:09.653199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.654856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bbb0a-8986-4347-813f-c62ba53b437e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.665975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766382a5-e50c-47c2-8a76-4141b5863413 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.690776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 340/676] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:09.692416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.692651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.693187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.711987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:09.713217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:09.718609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.719254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.719530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.719805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.731971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.733764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:09.749845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:09.750850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:09.751744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:09.751744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:09.751744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:09.756172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 337/677] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:09.757256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.771620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.790791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 341/678] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:09.801839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.869688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:09.889660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cee05-0998-4c63-a0f8-a91d44a5960d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.934203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207592f-a1d4-4f69-a08d-4a14b62956d5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:09.934745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.934875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.935122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.935364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.936061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:09.936369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.937852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.957692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 338/679] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:09.959590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:09.974894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:09.975400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:09.975691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:09.975973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] PATH_INFO: `/v3/users/swift` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:09.983777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:09.985259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:09.997679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:09.998678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:09.999615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:10.004315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 342/680] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:10.004535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.041247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.078417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f5fa9-705c-47e2-b663-d7f211029f8b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.117305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.117815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1f53-bae9-4440-ab18-9f6337c3c20d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.117951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.118201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.118480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.119139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:10.119439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.120823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.132630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 339/681] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:10.133509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.141148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.160964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.162530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.163009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.163296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.164038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=37d12b58ffac40e8a90d32748f470a61) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:10.164357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.165812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.172310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 343/682] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/role_assignments?user.id=37d12b58ffac40e8a90d32748f470a61&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:10.173087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.267142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34239fa-76d6-496a-af19-3768bd3c9ea7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.298947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.308138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.313368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.313368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.313368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.313368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:10.313368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.314107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360d36-bbe6-470b-81b9-cf1eb1289b43 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.314351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.335378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 340/683] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:10.336268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.356402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.357336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.357837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.358382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.376741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:10.383977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:10.385949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 344/684] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:10.387416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.455621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.483681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081e94d-7bad-4c5d-b056-a2fe09703acb None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.534505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.535144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.535432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.535713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.541935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044db5e-d79a-4cf9-89a7-ce8a52c3e28a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.543659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.545346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:10.564329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:10.565496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:10.566584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:10.567120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 341/685] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:10.572098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.585837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.586608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.586997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.587418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.629610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.669435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.671299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.690246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fdc00-61f5-44c6-ba99-334b0a3c5fd0 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.722672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.729712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.730328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.730610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.730885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.731558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:10.731862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.733402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.743851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 342/686] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:10.749184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.826167 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 345/687] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:10.826356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.892518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3aa2-ac3c-4bf8-b8eb-ef025ba0a28e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.904974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:10.932842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.933510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.933800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.934257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:10.934843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:10.935156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:10.936749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:10.951428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 343/688] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:10.952823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:10.953575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2153ee-8883-4b04-9e63-cdaf1b1ac0f1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:10.995631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:10.996540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:10.997012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:10.997442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.008080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.011521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.013198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:11.030514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:11.031574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:11.032515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:11.032515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:11.032515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:11.034857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 346/689] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:11.035889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.073495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945bb5-6089-49f8-80c3-916d3e1dd04c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.113704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.114970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.115576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.115939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.127277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.128914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:11.146552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:11.147576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:11.148467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:11.148467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:11.148467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:11.152544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 344/690] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:11.153845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.166136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da7fb-9413-4b45-ba34-4f349e4998b6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.180400 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.204183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.204800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.205172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.205456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.206202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=36a39e19ba8648ceb28c67d22c00e3fb) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:11.206517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.207955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b4e21-5fdc-4060-a599-70bda2aa1122 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.221147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 347/691] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/role_assignments?user.id=36a39e19ba8648ceb28c67d22c00e3fb&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:11.223569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb9b25-4704-4d29-ab80-0a6939d5e8e8 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.224707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb9b25-4704-4d29-ab80-0a6939d5e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.225323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb9b25-4704-4d29-ab80-0a6939d5e8e8 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.228125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 348/692] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:11.229367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb9b25-4704-4d29-ab80-0a6939d5e8e8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.284272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8272d9-dc80-4451-b9fc-998f772c2348 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.328375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.328900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.329222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.329560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.330235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:11.330619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.332055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560fac-f0cd-41b6-96e2-cfbf0b04ac2b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.333449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.354767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 345/693] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:11.354767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.354767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.354767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.376088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:11.377272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:11.394093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb9b25-4704-4d29-ab80-0a6939d5e8e8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.448605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.449330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.449622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.449926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.450567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:11.450878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.452264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.461073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 346/694] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:11.461808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.468309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 349/695] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:11.473615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.495235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.606092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0fd5c-c61e-47c6-bde1-70b075bf2ab6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.625654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.648034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.648635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.648929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.649233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.656731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.658783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:11.672678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:11.673651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:11.674530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 350/696] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:11.681267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.717955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1981a-b304-4ec3-bf1d-09080144efa6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.759329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.759973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.760253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.760529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.774304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.775868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:11.790382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:11.791394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:11.792313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:11.796614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 347/697] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:11.797474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.843826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da527-d37f-4b3d-ac4a-b2a9674e3586 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.880311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.880635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.881479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.881590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.881874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.882586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:11.882906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.884539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.898516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 351/698] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:11.899321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:11.918933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ace87-5b83-4087-b770-257a3891cd52 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:11.939721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:11.964748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:11.966023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:11.966486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:11.966984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:11.980538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:11.982486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:11.999055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:12.000525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:12.001721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:12.001721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:12.001721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:12.003438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 348/699] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:12.004513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:12.027606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a697546-b660-4e2a-9a84-ead662f72498 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:12.075946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:12.077180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.077898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.078394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.079963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:12.080468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:12.083178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:12.109304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 352/700] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:55:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:12.110569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:12.132840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a4e1-05cf-460f-9134-311a06171cc1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:12.160027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:12.177992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:12.178851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.179280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.179728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.180598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=4d48d9e6668b4866a21c2e0361fd3b88) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:12.181168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:12.182806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:12.193415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 349/701] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:12 2022] GET /identity/v3/role_assignments?user.id=4d48d9e6668b4866a21c2e0361fd3b88&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:12.194772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:12.227544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:12.235392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b06495-9fdf-4a0a-9f54-a15fbb79419f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:12.283024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:12.284020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.285525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.286039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.287009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:12.288445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:12.291942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:12.318253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 353/702] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:12.326149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:12.412020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4ed4e-be64-4d9a-a137-c6b3383573d5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:12.455334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:12.455948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.456227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.456501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.488912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c365dc-6caf-4229-80e9-f8c123c2457f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:12.537313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:12.540368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806915d-2a89-4eb4-8d9c-908d9783e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:12.541116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806915d-2a89-4eb4-8d9c-908d9783e835 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.541565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806915d-2a89-4eb4-8d9c-908d9783e835 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.541824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806915d-2a89-4eb4-8d9c-908d9783e835 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.542564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806915d-2a89-4eb4-8d9c-908d9783e835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:12.544131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806915d-2a89-4eb4-8d9c-908d9783e835 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:12.554123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:12.556140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:12.656212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 354/703] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:55:12 2022] POST /identity/v3/users => generated 254 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:12.656212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81492a6c-5d2f-4fec-b650-3a34f3c21659 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.661146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81492a6c-5d2f-4fec-b650-3a34f3c21659 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.662801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81492a6c-5d2f-4fec-b650-3a34f3c21659 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.671624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 355/704] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:12.677495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.677772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.678105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.712300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:12.714126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:12.717008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 350/705] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:12.726349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:12.727269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:12.878345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 356/706] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:55:12.885985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:12.902434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906848a-5485-4e25-a1a1-cf0286c69239 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:12.950449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:12.951428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:12.951907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:12.952450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:12.963930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:12.965763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:12.983019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:12.984042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:12.984963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:12.984963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:12.984963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:12.987090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 351/707] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:12.993449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.104742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07a76d-c79e-403c-b319-81b40c5c090f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.142840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.143461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.143751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.144032 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.144756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:13.145104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.147574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.157100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:13.164404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:13.168204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.178025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.316124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ea5f-6c99-4246-80a2-6e578b0687df None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.329472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f188c8-d1af-4256-be3c-c80835d2c26f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.385426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.386584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.387569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.388415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.397693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.398639 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.399143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.399640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.400432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.402045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.403809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.406771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.417290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:13.424069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:13.425091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:13.433539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:13.439513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:13.440369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:13.441296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:13.442450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 358/709] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 30 00:55:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:13.444195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 352/710] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:13.446119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.452447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.564652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:13.608731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fd3b-0f99-4dbd-a876-7b7d645a43e7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.609423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29b549-3acf-4a27-a6c6-459c658df835 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.649875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.650535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.650814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.651085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.651714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:13.652165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.653861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ed1e4-c5dc-493e-84a2-3e253f1c5c4f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.655606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.656611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.656896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.657470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.658172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:13.658482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.659333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 359/711] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 30 00:55:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:13.659922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4c89f-be87-4405-be55-10cfc0ead8d1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.660668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc532-a1c8-4d24-b14f-c3995fcc302d None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.661049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc532-a1c8-4d24-b14f-c3995fcc302d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.662026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc532-a1c8-4d24-b14f-c3995fcc302d None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.667361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 360/712] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:13.668281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fc532-a1c8-4d24-b14f-c3995fcc302d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.675561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 353/713] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:13.677513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.677811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.678089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.706177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:13.707403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:13.770707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:13.787196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 354/714] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:13.788275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:13.801300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fc532-a1c8-4d24-b14f-c3995fcc302d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.848671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:13.861330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.862231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.862231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.862430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.863069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:13.863375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.871562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.884411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 361/715] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 30 00:55:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:13.902239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ffc98-50dd-4595-a420-82fd5e3acd6e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:13.945694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:13.946574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:13.947042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:13.947513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:13.948454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=e3083107d17b4596b7b858df7fc50147) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:13.948923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:13.950542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:13.957056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 355/716] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:13 2022] GET /identity/v3/role_assignments?user.id=e3083107d17b4596b7b858df7fc50147&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:14.119999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:14.230976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1b633-4168-4e36-aa78-089179b43fe8 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:14.268672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:14.269338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.269626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.269911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] PATH_INFO: `/v3/services/network` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.270594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:14.272026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:14.281416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:14.282440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:14.283274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:14.288037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 362/717] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:14 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:14.289816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:14.379536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:14.435567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70867b9-628d-43de-94de-1e89546cfe2c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:14.477166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:14.478152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.478649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.479163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.480003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] RBAC: Adding query filter params (name=network) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:14.480514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:14.482199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5872343-dde2-413b-a5c7-d6459c5afa34 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:14.487676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 356/718] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:14.493747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:14.590501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:14.639598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0bb8-4a70-49f3-8ac5-b3dc6e5304ad None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:14.658510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b777d-7641-435c-8437-3b00208664f3 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.659138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b777d-7641-435c-8437-3b00208664f3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.659647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b777d-7641-435c-8437-3b00208664f3 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.661563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 357/719] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:14.666717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.667284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.667772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.675248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:14.675885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:14.676227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:14.676512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:14.677959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] RBAC: Adding query filter params (type=network) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:14.678311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:14.681784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:14.690608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 363/720] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:14.700176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:14.701877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:14.816150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 358/721] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:15.123612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:15.262147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fdd68-5dcf-40fd-b558-021b23e0d8ac None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:15.291199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:15.309988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:15.311040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.311512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.312056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.333923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:15.339610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:15.340533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:15.341403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:15.343377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 364/722] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:15.349949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:15.401917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:15.461271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdddbb-8f68-4d13-81b5-51eb97bbbc7c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:15.498105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:15.499103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.499538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.499964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.500811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:15.501324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:15.502892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c4bac-2f46-41df-a089-cfa584d67fb5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:15.512831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 359/723] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:15.518252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:15.540898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8b01b-b89e-4b11-b357-bae277d1fa5d None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.541474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8b01b-b89e-4b11-b357-bae277d1fa5d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.541904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8b01b-b89e-4b11-b357-bae277d1fa5d None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.543604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 360/724] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:15.549932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.550391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.550841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.576868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:15.579632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:15.713439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8f34-0587-49dd-99b2-b5e476c689fe None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:15.714277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 361/725] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:55:15.770753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:15.772283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:15.774600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:15.775106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:15.796738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:15.798413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:15.819590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:15.821412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:15.822323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:15.822323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:15.822323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:15.822323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 365/726] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:15.826821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:15.901056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:15.989577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95bbd-0fa0-4083-8253-abe5bf106504 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:16.012707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:16.058826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:16.059444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.059729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.060000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.060653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:16.060964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:16.062355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:16.073321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:16.089108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 362/727] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:16.094103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:16.207173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045dd59-2555-497a-aae7-ed10afa92abe None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:16.276467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:16.276899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.277165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.277444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.287182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:16.291609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113e535-2fe2-4cc6-b297-c78545850aa2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:16.298657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:16.303522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:16.310235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:16.311105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:16.313123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 366/728] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:16.319307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:16.335181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:16.336246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.336741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.337369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.347634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:16.350431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:16.362998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:16.364022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:16.365354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:16.367988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 363/729] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:16.373320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:16.487562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e64493-f54a-467b-9e7c-de17383fbd70 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:16.526620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:16.533704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:16.549418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.549418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.549418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.549418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:16.549418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:16.549418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ece7a-822b-48fd-a514-284e9695c640 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:16.549944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7672be-00d9-49f1-9ac1-d1bf607c39e5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:16.557476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 364/730] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 30 00:55:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:16.558582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c459c-9246-4e73-8bbf-13c0ca6cbd75 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.558987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c459c-9246-4e73-8bbf-13c0ca6cbd75 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.559365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c459c-9246-4e73-8bbf-13c0ca6cbd75 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.560751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 365/731] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:16.561940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab633b-2a71-45db-9408-96f33ea22e89 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.561940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab633b-2a71-45db-9408-96f33ea22e89 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.562245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab633b-2a71-45db-9408-96f33ea22e89 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.563968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 366/732] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:16.569634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f428-f67c-44e4-a85d-e500d9bbc38b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.570452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f428-f67c-44e4-a85d-e500d9bbc38b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.570452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f428-f67c-44e4-a85d-e500d9bbc38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.589389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7f08f428-f67c-44e4-a85d-e500d9bbc38b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:16.590679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7f08f428-f67c-44e4-a85d-e500d9bbc38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:16.600509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:16.601163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.601751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.601751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.602381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:16.602689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:16.603581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:16.604065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:16.618101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 367/733] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:16.618101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:16.685007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 367/734] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:16.685766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.686054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.686334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.710201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:16.711409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:16.763555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c5c8-ca14-4aa2-a5ea-3e98b734df93 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:16.796365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 368/735] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:16.796365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:16.814189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:16.815623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:16.816084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:16.818802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:16.845334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:16.902619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:16.904923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:16.978447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.008384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235465f-5f4d-4f9c-b659-79cf33069f03 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.035708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 368/736] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:17.040827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.044887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.045555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.045844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.046126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.057182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.058718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-f53c5ee7-4742-47cb-bd39-68bcc1079ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:17.075083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:17.076298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:17.077223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:17.077223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:17.077223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:17.077223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 369/737] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:17.077525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4e52-6c84-4040-8b7b-392070715928 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.077820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4e52-6c84-4040-8b7b-392070715928 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.078102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4e52-6c84-4040-8b7b-392070715928 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.083779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 370/738] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:17.084659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4e52-6c84-4040-8b7b-392070715928 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.108115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.157815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c216-931f-4b9e-b116-58d47f6897b7 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.192715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4e52-6c84-4040-8b7b-392070715928 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.193209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.193846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.194128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.194417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.205909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:17.212149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:17.213577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 369/739] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:17.214406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.221083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.229433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.230071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.230358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.230638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.241578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.243041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c65d2b71-7838-4218-bb96-f8ad808e4a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:17.259619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:17.260612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:17.261551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:17.261551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:17.261551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:17.261551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 371/740] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:17.262160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.262282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.262641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.280492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:17.281702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:17.326224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431a919-ea15-4885-9925-fd52219ee265 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.340100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.352394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 372/741] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:55:17.353345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.363564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.365243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.365465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.365926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.366580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:17.366890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.368291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.382650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 370/742] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:17.387241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.464309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73d5c-23cf-4950-adc4-0573c44f894b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.476558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.495465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af2b7e-e2c0-4214-95c5-5b8c97bd4596 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.502194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.502812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.503097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.503888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.504628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.506628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.535519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.536678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.536980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.537446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.538125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:17.538435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.539802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.552422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 371/743] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:17.552422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.590470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.635212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 373/744] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:17 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:17.636118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.661158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914a12e-a5cd-41f7-93c5-3b2c868fa6e2 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.716132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.716823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.717156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.717441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.718130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:17.718446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.719870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.738730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 372/745] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:17.741673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.762512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ad923-80c6-4a87-81ff-b4bc59442560 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.810270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.810929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.811255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.811536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.822519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.824295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:17.841896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:17.843176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 374/746] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:17.844408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.874792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.882029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:17.884009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c615b4-e2b5-4bc4-b61a-8fd2f4b03c8e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:17.920409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:17.921092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:17.921385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:17.921667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:17.932294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:17.933788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:17.950116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:17.951114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:17.952022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:17.952022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:17.952022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:17.955914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 373/747] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:17.956789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:17.972780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417131a-4498-4094-9e42-ace358ec80b6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.010964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.011710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.011974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.012139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.012794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.014232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.072490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e3a14-aeaf-424f-b9f5-1bd98eeb6179 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.089005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 375/748] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:17 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:18.089005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.132229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.132657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.132970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.133257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.142599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.144117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.148754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:18.161695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:18.164397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:18.165336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:18.165766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 374/749] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:18.166606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.223414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:18.234878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62364-2abd-4de9-bc91-031a8a3b1c6c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.277569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.278276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.278563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.278843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.279591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:18.279902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.281781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.294880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32471-baec-4f8b-8fbe-88babc824fda None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.307446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 376/750] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:18.308756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.347021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.349598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.349598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.349814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.350662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:18.350974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.352372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.365039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 375/751] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:18.366102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.425575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:18.430698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836df2b-e776-40a7-a623-4347a9bb7df9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.475478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b5ba9-20b9-42a4-a65c-0ba950325389 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.478982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.480530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.481059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.481531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.482440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:18.482959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.484744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.498634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 377/752] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:18.499743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.513847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:18.515207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.516011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.516478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.516897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.594284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.596085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.612442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51251e-af9d-420b-b9d4-96b692cfce46 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.653473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.654350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.654731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.655106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.662085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:18.665030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.666591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:18.679378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:18.680740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:18.681971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:18.688110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 378/753] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:18.688110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.722953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 376/754] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:18.724929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.769500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:18.811326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb9cc5-af90-4285-a9a8-bf418589e052 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.847519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b63c37-d319-476c-889e-dd102eb8b00b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:18.857966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.858920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.859818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.860267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.861601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=4d48d9e6668b4866a21c2e0361fd3b88) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:18.862627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.864768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.876053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 379/755] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/role_assignments?user.id=4d48d9e6668b4866a21c2e0361fd3b88&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:18.877836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.908690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:18.911375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:18.912113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:18.913558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:18.914760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:18.917863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:18.920174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:18.955463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 377/756] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:18.962814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:18.991721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.102608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3b2f3-46ae-4199-832f-27f744c540cd None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.120588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4db6b-e2f4-4d49-b37b-4866e5482f6a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.145274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.146951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.147347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.147731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.155657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.159318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.160899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.162743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.163566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.163992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.164477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.175764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.177568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:19.179883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:19.180987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:19.182011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:19.182011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:19.182011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:19.182601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 378/757] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:19.188635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:19.197223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:19.198179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:19.199055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:19.199055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:19.199055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:19.205084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 380/758] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:19.206956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.265512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.300884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127c242-b401-4d30-89f0-de94c69c2493 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.343164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.344151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.344643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.345276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.346169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:19.346686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.348287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.359037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757507-0e51-4401-9233-06e99b8a447b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.362678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 379/759] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:19.369106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.432348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.434239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.435796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.437815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.438978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:19.440022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.443440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.473646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 381/760] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:19.477419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.546886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697bdb7-5116-46ec-a0a3-4a84b622f481 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.579094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.591035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.591975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.599969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.599969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.600170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.605289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.609503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:19.626425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:19.627388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:19.628302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 380/761] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:19.636204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.690621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea01b2-f798-4e51-bede-ae7ddb2ab50b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.738109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.739697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.740228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.741069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.749365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.751906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:19.766174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:19.767140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:19.768025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:19.771968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 382/762] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:19.777722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.836284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd7ff0-c3d9-47fe-8406-31cd1229aa65 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.896007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ef416-6aeb-4864-a15d-4938b2882022 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:19.899053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:19.933308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.933921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.934221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.934461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.935151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:19.935465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.937571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f0cc-7418-49fd-a34e-29a559517e02 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.947087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:19.948027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.949071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.949531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.950630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:19.951109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:19.952892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7aeb-ae45-4e35-a58b-867413fe1e4a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:19.957235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 383/763] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:19.959304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26afe-969c-4776-b133-a6f20e721826 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.959690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26afe-969c-4776-b133-a6f20e721826 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.960064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26afe-969c-4776-b133-a6f20e721826 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.966168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 384/764] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:19.967067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26afe-969c-4776-b133-a6f20e721826 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:19.968331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 381/765] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:19.974855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:19.975145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:19.975418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:19.995421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:19.996645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:20.058371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:20.088851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 382/766] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:20.090769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:20.098247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26afe-969c-4776-b133-a6f20e721826 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:20.136913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:20.137571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.137822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.138115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.139080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7236db7932e2438db1c71d596d1e17f4) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:20.139258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:20.140704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e943488-e844-44b8-a459-44a5d20ea145 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:20.148155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 385/767] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:19 2022] GET /identity/v3/role_assignments?user.id=7236db7932e2438db1c71d596d1e17f4&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:20.214490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad907a-0481-416e-89eb-a5e1990765f3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:20.253735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:20.255430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.255918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.256568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/e3083107d17b4596b7b858df7fc50147/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.259215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=e3083107d17b4596b7b858df7fc50147, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:20.261054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:20.339017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63c28-f69b-40e5-8dcc-320277c319e0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.339357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63c28-f69b-40e5-8dcc-320277c319e0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.339583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e63c28-f69b-40e5-8dcc-320277c319e0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.341279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 386/768] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:20.346840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.347335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.349187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.359017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 383/769] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:20 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/e3083107d17b4596b7b858df7fc50147/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:20.378030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:20.379261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:20.418019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:20.475980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 387/770] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:20.480234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:20.543391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:20.609868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51cc7-a4f6-42f8-af94-a1eaeef6f12c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:20.647522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:20.648254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.648544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.648826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.649500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:20.650940 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:20.661753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:20.662750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:20.663581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 384/771] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 30 00:55:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:20.670487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:20.777075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6df60-8c12-4253-9ad1-58f6dcf33ddd None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:20.828666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:20.829371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:20.829663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:20.829947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:20.830586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:20.830893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:20.832318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:20.840922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 388/772] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 30 00:55:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:20.846895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:20.888840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:20.927381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:21.036626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6b054-0f21-42cb-9eea-1b350e9ad3a5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.041050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:21.078842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a63d-b757-4b6e-a942-81bbab407a63 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.099392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.100062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.100350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.100635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.101322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:21.101667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.103129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.116129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.116759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.117070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.117347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] PATH_INFO: `/v3/services/network` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.117939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.119302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.119714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 385/773] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 30 00:55:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:21.130774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:21.131357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:21.132317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:21.133181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 389/774] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:20 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:21.142950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:21.290329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0238-1935-48c9-9e8a-d5fcf315e630 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.292435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:21.315276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3a955-2534-4dbf-ad03-f9cfe3ef8fe1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.332681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.334063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.334388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.334782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.335560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] RBAC: Adding query filter params (interface=public, service_id=b9580c42c7c046aa864b1e65b7724ad9, region_id=RegionOne) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:21.335999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.337557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2fa75-6f35-4474-a743-cf3fe5fe87c1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.345719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 386/775] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/endpoints?service_id=b9580c42c7c046aa864b1e65b7724ad9&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:21.347058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e0ede-055a-4020-bfe0-3fd1a3f05dbd None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.347415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e0ede-055a-4020-bfe0-3fd1a3f05dbd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.347766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e0ede-055a-4020-bfe0-3fd1a3f05dbd None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.353929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 387/776] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:21.354874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e0ede-055a-4020-bfe0-3fd1a3f05dbd None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:21.357314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.358158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.358442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.359692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.360346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] RBAC: Adding query filter params (name=network) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:21.360656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.362066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70d7c1-1642-4a57-88eb-3e9539f09769 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.369488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 390/777] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:21.371021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.371309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.371590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.390989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:21.397514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:21.398762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:21.477955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e0ede-055a-4020-bfe0-3fd1a3f05dbd None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.497641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 391/778] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:21.498580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:21.524721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.525405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.525741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.526022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.526703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.528202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.534584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 388/779] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:21.605156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:21.625253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2ee28-845a-40a7-aa34-095a519547e8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.663896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.664517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.664801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.665112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.665764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] RBAC: Adding query filter params (type=network) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:21.666069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.667521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.674578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 392/780] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:21.681087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:21.821173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:21.830788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968aa47-cc9e-49e7-ba00-bc10b6b7c60e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:21.843523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:21.892024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:21.892216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:21.892442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:21.892699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:21.893463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] RBAC: Adding query filter params (interface=public, service_id=2750c847948f4426be661eba1a9eb231, region_id=RegionOne) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:21.893777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:21.895155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:21.903901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 389/781] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/endpoints?service_id=2750c847948f4426be661eba1a9eb231&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:21.907757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:22.088895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63718a-ba3a-4b06-8a51-9979ffdd976b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:22.115818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b427aaf-a385-4f99-bf2a-95037e5a3171 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:22.163118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:22.163763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.163989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.164219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.184718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:22.188157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:22.189061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.189341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.189614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.190227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:22.191596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:22.193456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:22.194408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:22.195238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 393/782] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:22.203018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:22.209708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:21 2022] GET /identity/v3/services => generated 772 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:22.210069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:22.354325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b58472-fc12-482c-a0b0-8a62312dd247 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:22.393408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:22.394231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.394510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.396707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.396707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:22.396707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:22.400969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326c77-0f68-4a33-9011-1c93f9448c42 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:22.407181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 394/784] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:22.413457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:22.444630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:22.451054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f573e1-5f32-4e0b-ba6c-fe33e172d07c None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.451618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f573e1-5f32-4e0b-ba6c-fe33e172d07c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.451901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f573e1-5f32-4e0b-ba6c-fe33e172d07c None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.453585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 395/785] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:22.464005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.465300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.465300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.485839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:22.487047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:22.557341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410524d4-a719-4e1f-9794-c0a7ea14999b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:22.567214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:22.578503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 396/786] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:22.607123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:22.607775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.608062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.608340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.620923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:22.622621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:22.644373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:22.646700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:22.648954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:22.648954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:22.648954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:22.653915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 391/787] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:22.659727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:22.812921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3a6af-781f-4372-abc1-a4f1ec716ae3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:22.859555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:22.860356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:22.860767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:22.861144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:22.862129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:22.862631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:22.864747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:22.877696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 397/788] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:22.886327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:22.976732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:22.980687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.008069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001641f7-b449-4330-a58b-aa37c0ccddee None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.052610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.055548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.056545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.056834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.057408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.067849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.070136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-15027e1f-c765-432f-9503-ddcff56b7c84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:23.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:23.086964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:23.088084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 392/789] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:23.088788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2819d-9a78-4a12-8293-20999cdfee12 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.088788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2819d-9a78-4a12-8293-20999cdfee12 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.088965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2819d-9a78-4a12-8293-20999cdfee12 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.097060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 393/790] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:23.097060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2819d-9a78-4a12-8293-20999cdfee12 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.111331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05e30-fe13-48c6-9984-d950317c45a7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.150388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd2a30-3052-4ee9-873b-aacf5fcabd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.151310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd2a30-3052-4ee9-873b-aacf5fcabd46 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.151700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd2a30-3052-4ee9-873b-aacf5fcabd46 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.152100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd2a30-3052-4ee9-873b-aacf5fcabd46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.166692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd2a30-3052-4ee9-873b-aacf5fcabd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-34bd2a30-3052-4ee9-873b-aacf5fcabd46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:23.173015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:23.174205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:23.175223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:23.182227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 398/791] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:23.186047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.186426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.186904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.211928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:23.213568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:23.233788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2819d-9a78-4a12-8293-20999cdfee12 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.272643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.273244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.273630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.274010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.274896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:23.275309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.276858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.279684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.304616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 399/792] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:23.306943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 394/793] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:23.307068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.307147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.413321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.494012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b664a-c56a-4128-9814-901c532198a2 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.521742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeb4c6-77c9-48d0-aff6-5c6029ab52c6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.538696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.539373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.539662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.539943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.560698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.562210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:23.593837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:23.594851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:23.595731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:23.595731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:23.595731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:23.597700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.598892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.599325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.599600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.600415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:23.600615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.602036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.604783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 395/794] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:23.610641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.624691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 400/795] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:23.637994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.674954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.737511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5264c9-af5e-48d7-b9b6-96ee69bf92eb None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.771629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451e3b6-606f-4792-9380-dab7e9d5db8a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.779070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.779695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.779983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.780266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.780769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.781562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:23.781871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.783245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.798187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 396/796] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:23.799070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.813856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.814503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.814913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.815383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.829566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:23.831041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:23.846437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:23.847938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:23.857211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:23.857211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:23.857211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:23.857211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 401/797] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:23.857211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:23.929498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9139839-7ef3-4440-ba05-5882b64a8428 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.937558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:23.964836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d04e0-b6dd-4a36-9d7e-0262e14f0813 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:23.966760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:23.967512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:23.967796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:23.968069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:23.980200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:23.985692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:23.986631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:23.987465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:23.992462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 397/798] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:23.993345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.002838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.003479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.003765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.004046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.011354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.012819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-8d516dce-1427-4135-9bff-08ace7f88765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:24.024133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:24.025155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:24.026057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 402/799] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:24.026543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77630e61-2b29-4610-a7a0-0bd70237ced5 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.026949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77630e61-2b29-4610-a7a0-0bd70237ced5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.027050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77630e61-2b29-4610-a7a0-0bd70237ced5 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.032153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 403/800] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:24.032153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77630e61-2b29-4610-a7a0-0bd70237ced5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.054378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:24.116310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93480917-be25-4cb2-b732-78cba631f209 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.151958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.152566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.152928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.153190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.154007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:24.154130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.155482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.157960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77630e61-2b29-4610-a7a0-0bd70237ced5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.168818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 398/801] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:24.169903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.201813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:24.204419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.205968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.206528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.207067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.208845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:24.209475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.221042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a48acb-8fb7-49b1-b8cb-6708988fd539 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.226583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 404/802] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:24.226583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.226583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.226583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.245178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:24.246393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:24.286064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af96fa-5b22-4d01-af51-9876a214b0e1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.324604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.325259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.325548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.325827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.326549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:24.326859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.328313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.342309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 399/803] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:24.343183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.451943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 405/804] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:24.452742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.462031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:24.474701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:24.484108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df00f-920a-44c0-ace5-1c14e3f00815 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.523574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.526180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.526821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.527596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.543532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.545071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:24.558425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:24.559520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 400/805] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:24.560519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.580532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc795312-2b05-4db1-a62b-3f84d1b61015 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.617673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.618375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.618578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.618852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.630990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.632577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-ab55762d-eb1d-46fd-874c-e45b39802874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:24.647410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:24.648391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:24.649329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:24.649329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:24.649329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:24.649329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 406/806] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:24.650362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda47c-0aaa-4fd3-8b52-0161119cdedc None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.650362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda47c-0aaa-4fd3-8b52-0161119cdedc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.650540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda47c-0aaa-4fd3-8b52-0161119cdedc None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.651817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 407/807] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:24.656424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda47c-0aaa-4fd3-8b52-0161119cdedc None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.680028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3da02-55fc-4889-8a4b-ad5ba8d72fd3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.717667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eeb0e-154b-4d37-b57c-43fb90085b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.718278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eeb0e-154b-4d37-b57c-43fb90085b37 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.718615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eeb0e-154b-4d37-b57c-43fb90085b37 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.718876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eeb0e-154b-4d37-b57c-43fb90085b37 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/4d48d9e6668b4866a21c2e0361fd3b88/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.720836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eeb0e-154b-4d37-b57c-43fb90085b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=4d48d9e6668b4866a21c2e0361fd3b88, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.722320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eeb0e-154b-4d37-b57c-43fb90085b37 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.726880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:24.765734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda47c-0aaa-4fd3-8b52-0161119cdedc None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.798306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:24.798912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.799197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.799477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.800205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:24.800513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:24.802740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:24.819222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 408/808] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:24.832729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.832904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 401/809] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:24 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/4d48d9e6668b4866a21c2e0361fd3b88/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:24.832904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:24.832904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:24.832904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:24.845779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:24.852450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:24.859766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:24.942116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 402/810] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:24.945897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:24.955108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93019-d6af-496c-bea3-c6aea219f6a8 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:24.998018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.012095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.016878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.016878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.016878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.016878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:25.016878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.016878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.031720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 409/811] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:25.032830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.084690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc76ce0-a898-45a0-bfb5-f3070ac2e57d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.121776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.122432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.122723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.123002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.123600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.124994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.128101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:25.135165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:25.137236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:55:25.138980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.140412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 403/812] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 30 00:55:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:25.140924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.157016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd047b-87fb-438f-97df-08cc0138e649 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.202742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.203380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.203656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.203970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.219956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.222901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:25.242957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:25.244193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:25.245290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:25.245290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:25.245290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:25.251396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 410/813] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:25.251396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.272057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b9cc-1f47-4644-a11e-412085c8af0a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.288203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.308312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.308969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.309263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.309545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.318188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.319642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:25.331083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:25.332047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:25.333660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.337262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 404/814] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:25.338175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.362946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aa8b2-a8ea-478b-9b6b-a1c64f209a39 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.401485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.402102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.402396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.402674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.403312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:25.403619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.404363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.405030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.412546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 411/815] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:25.413405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.460545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4aff-f9b9-4b57-9cf0-b2d8d737aa1c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.496953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.497586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.497861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.498130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] PATH_INFO: `/v3/services/network` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.498715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.500290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:25.511056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:25.512069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:25.521920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 405/816] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:25.522715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.529251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.533548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b8d8c-1075-4c80-868f-ca4ec7a69e24 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.569086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.569680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.569963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.570236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.570881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:25.571176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.572538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.585083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 412/817] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:25.585970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.633983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a044ead-6b8b-4bd0-a7fc-3e9d52df90a9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.664554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.675899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.677384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.677900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.678362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.679290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:25.679792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.681457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.697058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c38d9-7afc-444a-bede-4b48a95d3758 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.699705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 406/818] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:25.700714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.742022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.742630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.742913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.743191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.743825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:25.744126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.745548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.755388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 413/819] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:25.755388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.778459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:25.820699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98140779-fa2b-4f29-8d57-b3ce3a458cf4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.866998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.868102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.868610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.869170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.870359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] RBAC: Adding query filter params (name=network) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:25.870923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.871809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedc40c-79ac-4864-b8c0-ede914e75bee None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:25.873529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.884192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 407/820] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:25.884192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.918252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:25.918528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:25.918779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:25.919132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:25.926557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:25.928042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:25.940422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:25.941471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:25.942413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:25.946803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 414/821] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:25.947574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:25.958447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.020850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02649-47bc-4833-9454-8b2929f5ee26 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.040814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.058757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b37e2a-ad6e-4900-8739-cf875bc272a9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.059777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.060621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.062727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.062727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.095846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.096466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.096743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.097041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.097714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.100423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.147843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.149317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.199489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.206707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 415/822] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:26.207553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.301253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 408/823] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:26.301253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.405322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc76e3-1e6a-43f6-beff-95d44ba82106 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.444666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e406b06-62f9-45e8-a8f2-32d60b170d84 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.452986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.452986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.452986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.452986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.453426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] RBAC: Adding query filter params (type=network) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:26.453426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.453426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.453426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.461282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 416/824] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:26.463208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.492231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.492955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.493313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.493668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.494515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:26.494836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.496298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.509726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 409/825] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:26.510868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.529331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.628919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2f53-7621-4633-9b94-f0d5aefc3677 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.638416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702468-e673-433e-895c-fe76af16c8b9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.673777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.674558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.674943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.675323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.676384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.677231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.677648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.677995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.678747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.680202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.688965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.690978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:26.707360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:26.709713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:26.710614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:26.710614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:26.710614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:26.710614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 417/826] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:26.711270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.773335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.784081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 410/827] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:26.785508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:26.842802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73862-fcf9-4ee7-937a-5a63848a1a5f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:26.907074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e1cd1-2318-49a8-a5b3-2e09d078cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:26.907932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e1cd1-2318-49a8-a5b3-2e09d078cc9d None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:26.908219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e1cd1-2318-49a8-a5b3-2e09d078cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:26.909050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e1cd1-2318-49a8-a5b3-2e09d078cc9d None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7236db7932e2438db1c71d596d1e17f4/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:26.912074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:26.929882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e1cd1-2318-49a8-a5b3-2e09d078cc9d None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=7236db7932e2438db1c71d596d1e17f4, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:26.931525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e1cd1-2318-49a8-a5b3-2e09d078cc9d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:26.965541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cde546-b500-4584-a43f-71deac74c4d9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:27.005991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:27.006616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.006897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.007174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.007858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:27.008261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:27.009663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29205a-8bb7-4902-8d4b-272027c378a3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:27.024138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 411/828] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:27.027152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053f2b9-d9c9-4958-b115-1c5426edaa38 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.027152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053f2b9-d9c9-4958-b115-1c5426edaa38 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.027152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053f2b9-d9c9-4958-b115-1c5426edaa38 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.027152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 412/829] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:27.030244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053f2b9-d9c9-4958-b115-1c5426edaa38 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:27.064023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 418/830] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:26 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7236db7932e2438db1c71d596d1e17f4/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:27.067495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b671c-382d-4874-8572-51f6274d815e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.068444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b671c-382d-4874-8572-51f6274d815e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.068444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b671c-382d-4874-8572-51f6274d815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.100592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-683b671c-382d-4874-8572-51f6274d815e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:27.102719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-683b671c-382d-4874-8572-51f6274d815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:27.174691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053f2b9-d9c9-4958-b115-1c5426edaa38 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:27.190423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 419/831] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:27.209873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:27.223664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:27.224558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.225004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.225431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.234019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:27.235754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:27.248742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:27.249917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:27.251005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:27.253042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 413/832] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:27.259791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b671c-382d-4874-8572-51f6274d815e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:27.297320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:27.388135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b671c-382d-4874-8572-51f6274d815e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:27.425745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:27.427324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.427775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.428214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.429118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:27.429594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:27.431194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:27.445423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 420/833] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:27.451805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:27.481909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:27.594817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3211-8b42-4264-9b43-e570f525a78a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:27.601202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:27.625512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c94d4-6e98-45ba-a038-00626a763467 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:27.638439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:27.639173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.640815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.641074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.641790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=e3083107d17b4596b7b858df7fc50147) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:27.642101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:27.643581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:27.657496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 414/834] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:27 2022] GET /identity/v3/role_assignments?user.id=e3083107d17b4596b7b858df7fc50147&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:27.687409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:27.688855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.689448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.690016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.705425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:27.712166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:27.713260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:27.714130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:27.717039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 421/835] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:27.725757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:27.789829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:27.849943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279af3a-3654-431c-b2b7-a4b6f34605e2 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:27.888918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:27.889947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:27.890411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:27.890836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:27.891683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:27.892139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:27.893694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:27.905482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 415/836] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:27.912139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.028067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408b08b-aa60-4bc3-aed5-409c7bdc318d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.068036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.069160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.069672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.070150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.082253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.084755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.092025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:28.102115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:28.110102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:28.111006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:28.111006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:28.111006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:28.111006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 422/837] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:28.111236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.232879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5c92-4456-4085-a4e7-3692a1d594ef None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.244108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.275441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.276069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.276359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.276628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.277313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:28.277624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.279099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bbdcf-00f2-465f-b089-e3f4c98cef0a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.295191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 416/838] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:28.300663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.371645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14149d-7a39-4625-bc50-97d5283c5a00 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.372002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14149d-7a39-4625-bc50-97d5283c5a00 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.372213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14149d-7a39-4625-bc50-97d5283c5a00 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.374006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 417/839] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:28.382544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.382912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.383199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.403622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:28.405055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:28.416184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72d6b9-a7af-4015-88cf-0733794d96e0 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.452211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.452838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.453136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.453736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] PATH_INFO: `/v3/users/swift` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.462129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.463582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:28.476260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:28.477264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:28.478975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 423/840] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:28.483215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.485384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 418/841] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:28.560283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.596757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7944db-675a-4918-8f8d-c25d5d439842 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.631926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.632773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.633086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.633357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.634087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:28.634388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.635811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.653638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 424/842] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 30 00:55:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:28.659160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.759268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.762987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c4083-c6c1-4d9c-81d2-8e4246f0dd7a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.785341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:28.806946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.807585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.807873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.808149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.906155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.908401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.935045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb73cb-d26f-43e2-918f-1ce01fb49292 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:28.958468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:28.978426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:28.979255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:28.979635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:28.980008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:28.980698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:28.982251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:28.992258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:28.993649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:28.995336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:29.000277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 425/843] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:29.001211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.043642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.054812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 419/844] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:29.056171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.137258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844d4a2-e0ef-4c33-b1ca-02ec470f3d4e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.175765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb786-afcf-40bf-a99b-400b2ce2ad5d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.175944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.176604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.177122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.177483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.178129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:29.178439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.180385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.189196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 426/845] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:29.190758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.225804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.227070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.227810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.228694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.246115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.250042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.251514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-7c2ca8dd-104d-438b-8f2a-8574c568f34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:29.267664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:29.270789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 420/846] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903efa-8829-4431-8985-8716f5b20c8f None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903efa-8829-4431-8985-8716f5b20c8f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903efa-8829-4431-8985-8716f5b20c8f None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 421/847] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:29.277503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903efa-8829-4431-8985-8716f5b20c8f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.315325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ce7c-8dac-4563-bb4a-bb1020f418d1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.334480 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.360670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.361813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.362122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.362402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.363045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:29.363409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.365965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7135185-c4e1-422f-afb6-e4ef7cc7e3ce None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.373092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 427/848] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:29.374611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.375245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.375379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.397058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:29.398370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:29.404927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903efa-8829-4431-8985-8716f5b20c8f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.453199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.453889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.454258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.454602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.455389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:29.455762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.457377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.472410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 422/849] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:29.478728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.497990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 428/850] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:29.595656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b8723-0237-4823-8546-ba800c1b3430 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.607532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.632396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.633075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.633363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.633644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.640926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.642393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:29.654025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:29.654964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:29.656251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 423/851] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:29.662067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.704856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.769111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45317d91-d5b6-4ba1-a208-dd3a17437077 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.772052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.812384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.813056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.819563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.819563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.819563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:29.819563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:29.819563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0045e99-065a-46a6-b62d-d2e9082cc62f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:29.828090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 429/852] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:29.829392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a214d8-4c78-4f9e-9f8d-a02a7bd5875a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.829685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a214d8-4c78-4f9e-9f8d-a02a7bd5875a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.829967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a214d8-4c78-4f9e-9f8d-a02a7bd5875a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.831311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 430/853] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:29.836393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a214d8-4c78-4f9e-9f8d-a02a7bd5875a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:29.892264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a267fa-f525-4b2f-aa75-71b081c9acf0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.934971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611d126-c155-48c0-b0dc-1ded165a847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:29.935577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611d126-c155-48c0-b0dc-1ded165a847e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.935868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611d126-c155-48c0-b0dc-1ded165a847e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.936143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611d126-c155-48c0-b0dc-1ded165a847e None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.947173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611d126-c155-48c0-b0dc-1ded165a847e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:29.950267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8611d126-c155-48c0-b0dc-1ded165a847e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:29.952467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:29.953507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:29.954358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 424/854] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:29.955106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:29.955106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:29.955251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:29.959996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a214d8-4c78-4f9e-9f8d-a02a7bd5875a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:29.979288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:29.980482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:30.005019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:30.005682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.006301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.006620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.006855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.007577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=4d48d9e6668b4866a21c2e0361fd3b88) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:30.007883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.009339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.025375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 431/855] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:29 2022] GET /identity/v3/role_assignments?user.id=4d48d9e6668b4866a21c2e0361fd3b88&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:30.025375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.085117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 425/856] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:30.155360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe8b54-3847-4045-82a9-95e484171288 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.195529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.196136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.196415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.196688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.197405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:30.197695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.199064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.207795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 432/857] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:30.213266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.326954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b32ac-c150-402c-bde4-3166af104bfc None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.363428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.369654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.370565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.371092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.371572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.386031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.388554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.392404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:30.410046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:30.421522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:30.422425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:30.422425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:30.422425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:30.422425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 426/858] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:30.422425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.443939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:30.488363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee4fb3-b217-4df3-bd8d-32816378bef5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.537099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.538200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.538785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.539168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.539892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.542150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:30.556118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:30.557303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:30.558206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:30.558950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 433/859] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:30.564731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435fcbb-b57a-41a8-b071-f2ab20e475a3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.566446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.613247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.614468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.615406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.615694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.616361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:30.616664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.618554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.635987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 427/860] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:30.641177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.675263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:30.689803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1082db-0854-46cf-a197-246faab19149 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.731455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:30.747033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.747033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.747033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.747033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.747447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:30.747447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.747447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.751550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 434/861] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:30.758556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.769435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db0000-4125-438a-9a60-aaee8f4e4037 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.816531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.827701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.827701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.827701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.828621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.830867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:30.846469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:30.847452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:30.849669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 428/862] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:30.853614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:30.888696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33e917-05ad-40c5-99b7-89ec2a187d4b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:30.935855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:30.936921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:30.937511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:30.938118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:30.939222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:30.939740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:30.941363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:30.952922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 435/863] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:30.982742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150f16-df13-4ca7-9edd-077a49c12c9f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:31.017433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.022836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:31.023454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.023732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.024004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.024755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:31.025160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:31.026647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:31.048052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 429/864] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 30 00:55:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:31.054083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:31.077517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.180194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e86c8-a109-4a8d-a396-3ea3a9754dc3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:31.216295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e932-7a12-4ab0-bf1e-8ccab6496a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:31.217326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e932-7a12-4ab0-bf1e-8ccab6496a7e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.217807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e932-7a12-4ab0-bf1e-8ccab6496a7e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.218301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e932-7a12-4ab0-bf1e-8ccab6496a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.300097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e932-7a12-4ab0-bf1e-8ccab6496a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:31.302095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e932-7a12-4ab0-bf1e-8ccab6496a7e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:31.322346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.414343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 436/865] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:31.420377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:31.426982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ffc41-6cc3-49b2-b174-a07a4bd2b73d None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.427274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ffc41-6cc3-49b2-b174-a07a4bd2b73d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.427570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ffc41-6cc3-49b2-b174-a07a4bd2b73d None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.429203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 437/866] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:31.434255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53087b69-5f37-4398-9c41-13328d70311d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.434543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53087b69-5f37-4398-9c41-13328d70311d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.434823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53087b69-5f37-4398-9c41-13328d70311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.453417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-53087b69-5f37-4398-9c41-13328d70311d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:31.454624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-53087b69-5f37-4398-9c41-13328d70311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:31.535148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 438/867] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:31.540471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa8a95-2354-4d51-84a9-59a6934dd4a0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:31.577483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:31.578527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.579013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.579519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.591462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:31.593281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:31.610300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:31.611304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:31.612211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:31.612211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:31.612211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:31.614687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 430/868] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:31.620564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53087b69-5f37-4398-9c41-13328d70311d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:31.671945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.730411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53087b69-5f37-4398-9c41-13328d70311d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:31.766862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:31.767510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.767798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.768075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.768733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:31.769162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:31.771444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:31.784294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 439/869] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:31.790493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:31.808524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:31.855815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.918917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d079-e6f6-425f-a688-c316f38094f6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:31.920581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b056c0-21c4-4d8c-8e79-ec9921cbe82f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:31.926712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:31.959759 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:31.960842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.961393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.961862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.966171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:31.966792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:31.967078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:31.967361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:31.968049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:31.969667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:31.972519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:31.975382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:31.988052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:31.990554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:31.991497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:31.992294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 431/870] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:31.995598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:32.062855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 440/871] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:31 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:55:32.132903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fb80d-cea8-4f22-b56a-dc3003eae100 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:32.135333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:32.184832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:32.185509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:32.185805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:32.186088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:32.186862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:32.187184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:32.188929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2834a-52c9-460a-b434-107fd1eae20a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:32.202922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 432/872] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:32.209568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:32.249441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25088-8d52-48ff-8e4d-5c7e918c7094 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:32.249751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25088-8d52-48ff-8e4d-5c7e918c7094 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:32.250002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25088-8d52-48ff-8e4d-5c7e918c7094 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:32.251957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 433/873] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:32.257470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:32.258490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:32.258773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:32.281549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:32.282733 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:32.337687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899878bc-edaa-4999-8fab-b18aeada4b8d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:32.374846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 434/874] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:32.386823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:32.387385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:32.387669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:32.388009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:32.388745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7236db7932e2438db1c71d596d1e17f4) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:32.389086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:32.390578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:32.398001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 441/875] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:32 2022] GET /identity/v3/role_assignments?user.id=7236db7932e2438db1c71d596d1e17f4&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:32.666065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:32.768603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:32.782123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f24bfe-5b7e-4172-b903-a92c8ab879c7 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:32.821270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:32.821922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:32.822204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:32.822484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:32.823147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:32.824526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-d3a0de02-b4c4-4cbf-8f97-6d15ece22ed0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:32.835512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:32.836536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:32.837392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:32.841094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 435/876] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:32.846137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:32.884494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:32.961579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f92793-2da3-4d3f-a75c-d1f39cb86de7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:32.999696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:33.000709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:33.001219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:33.001715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:33.002560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:33.003067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:33.004740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:33.010312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 442/877] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:33.017074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc008e-7754-4b01-bb4f-adfe1b23dc93 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:33.017074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc008e-7754-4b01-bb4f-adfe1b23dc93 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:33.017074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc008e-7754-4b01-bb4f-adfe1b23dc93 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:33.017074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 436/878] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:33.017761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:33.021350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:33.021631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:33.021901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:33.040902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:33.042123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:33.115404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 437/879] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:33.142055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:33.154167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb24bbb-0691-44d6-afe1-cb2703406426 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:33.190386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:33.190999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:33.191275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:33.191552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:33.192725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:33.193058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:33.194429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe1e5a-eeb8-496d-8141-f77a52e8d836 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:33.199466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 443/880] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:33.432390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:33.523047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:33.542467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5d10f-9c41-4e37-89c5-91e109f73692 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:33.579893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815e4a-3956-4775-aa6f-1067b3f458a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:33.580513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815e4a-3956-4775-aa6f-1067b3f458a8 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:33.580803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815e4a-3956-4775-aa6f-1067b3f458a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:33.581112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815e4a-3956-4775-aa6f-1067b3f458a8 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:33.581784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815e4a-3956-4775-aa6f-1067b3f458a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:33.583925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09815e4a-3956-4775-aa6f-1067b3f458a8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:33.737624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 438/881] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:33 2022] POST /identity/v3/services => generated 269 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:34.189535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23e76-996d-44a3-bdbc-56ab3cf09969 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.190056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23e76-996d-44a3-bdbc-56ab3cf09969 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.190056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23e76-996d-44a3-bdbc-56ab3cf09969 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.192392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 444/882] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:34.197569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8f14-2117-4c10-896b-ff144150fc08 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.198017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8f14-2117-4c10-896b-ff144150fc08 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.198222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8f14-2117-4c10-896b-ff144150fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.218592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-73cd8f14-2117-4c10-896b-ff144150fc08 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:34.219793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-73cd8f14-2117-4c10-896b-ff144150fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:34.310612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 439/883] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:34.629221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23e76-996d-44a3-bdbc-56ab3cf09969 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:34.649664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be1e15-34fa-4799-8f78-f6cff132cb6f None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.650016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be1e15-34fa-4799-8f78-f6cff132cb6f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.650233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be1e15-34fa-4799-8f78-f6cff132cb6f None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.652041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 440/884] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:34.657299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.657591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.657874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.681125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:34.682663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:34.763012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23e76-996d-44a3-bdbc-56ab3cf09969 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:34.768535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:34.775004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 441/885] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:34.812633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:34.813593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:34.813876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:34.814149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:34.814733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:34.816115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:34.825408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:34.826435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:34.827275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 445/886] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:34.832708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:34.960928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7b42-cb82-41b6-8a5c-fa82558d6d3f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.002558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.003295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.003575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.003851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.005627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:35.005935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.008003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.021197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 442/887] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:35.026944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.069814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.070914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.157408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.177102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3d42c-f0fc-4372-a8c7-b47aaab2d06a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.209373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6d11-6dcb-41e4-a059-0c564815c66c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.229637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.230686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.230967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.231246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.232542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:35.233014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.236360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.245662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 446/888] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:35.252058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.267513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.269307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.269910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.270367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.294289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:35.302904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:35.310077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:35.313652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 443/889] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:35.317377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.392214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.413475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b79426-40e0-4ccb-a33c-5f0559f4c8e1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.453822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.454444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.454718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.454995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.455698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] RBAC: Adding query filter params (interface=public, service_id=57b1f957aaac43978740cac3e6b31c93, region_id=RegionOne) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:35.456005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.457453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91975f01-addf-4d12-92f0-272273cb6e43 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.459085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197517a-4ef0-48a5-b6f0-8eb99da87077 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.465999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 447/890] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/endpoints?service_id=57b1f957aaac43978740cac3e6b31c93&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:35.467631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f527bf-e61d-4c5e-8019-070e0ba6d78a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.468128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f527bf-e61d-4c5e-8019-070e0ba6d78a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.468823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f527bf-e61d-4c5e-8019-070e0ba6d78a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.472422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 448/891] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:35.474224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f527bf-e61d-4c5e-8019-070e0ba6d78a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.501087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.521902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.522935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.523664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.524203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.525396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:35.526004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.528505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c479962-883d-476a-be0c-067b1f7b7b53 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.543095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 444/892] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:35.545199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.545570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.546243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.571365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:35.572575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:35.627213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f527bf-e61d-4c5e-8019-070e0ba6d78a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.680501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a699a-1922-4e1a-87d2-ab62b492cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.681408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 445/893] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:35.681572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a699a-1922-4e1a-87d2-ab62b492cd33 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.681867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a699a-1922-4e1a-87d2-ab62b492cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.682153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a699a-1922-4e1a-87d2-ab62b492cd33 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.682617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:35.682775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a699a-1922-4e1a-87d2-ab62b492cd33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.684146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a699a-1922-4e1a-87d2-ab62b492cd33 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.698442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 449/894] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/services => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:55:35.896454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebc0d2-67c2-4996-aa5f-aa3a7e23a460 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:35.901814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5dc41-0dcc-4f34-9f76-6788ede29e6f None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.902424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5dc41-0dcc-4f34-9f76-6788ede29e6f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.902909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5dc41-0dcc-4f34-9f76-6788ede29e6f None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.904731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 450/895] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:35.909658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.909941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.911091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.916319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.930674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:35.932225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:35.946999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.948338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:35.949020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:35.949307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:35.949928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:35.965328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:35.967083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:35.988882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:35.989910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:35.990788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:35.990788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:35.990788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:35.993021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 446/896] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:35.997335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.025885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 451/897] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:36.042758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.160066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddd3d1-2d39-4de8-b353-0ba68e7d5cc1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.165451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e96fc-e5c6-46ef-b89b-06e8c0cd5777 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.213466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.214276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.214596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.214979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.215922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:36.216515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.216786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.217587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.218092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.218553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.219391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.219650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.221216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.236518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 447/898] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:36.243165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.272569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.312970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 452/899] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:36 2022] POST /identity/v3/services => generated 241 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:55:36.318138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.322134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.369406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a57eb6-41aa-4961-baea-cd186ca887f0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.418805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.419570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.419919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.420267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.433488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.436104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:36.453809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:36.454923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:36.456280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 448/900] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:36.463489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.464558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4bd8-b18c-467e-b937-7a4dcddfd422 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.514524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.515175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.515456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.515757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.516355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.518672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:36.536688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:36.537773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:36.539230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:36.541510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 453/901] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:36.550516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.586246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.611265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ca91-5782-499e-9ac0-b19805b6fa29 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.641690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.661417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.662386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.662905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.663367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.664274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:36.664765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.666559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.686907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 449/902] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:36.691192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2204c-cb1d-4e6d-8feb-8a6847e840c4 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.695170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.744083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.745770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.747992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.748726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.749933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:36.750566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.753559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.765009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 454/903] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:36.771288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:36.854150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff3eb5-c846-45fd-adb2-47e191d94cff None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.900370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.901575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.902044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.902499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.921361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.936195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af0ac-6877-410a-88c4-b6d621463c6b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:36.975225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.981514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:36.982452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:36.982892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.983169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:36.983663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:36.984348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.984867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:36.989713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:36.989713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:36.997107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 455/904] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:36.999386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.093901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 450/905] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:55:37.094811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.106696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9d233-e493-48ef-9d9f-9bfbad78967b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.141332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:37.143189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.143963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.144413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.145473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.146420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] RBAC: Adding query filter params (interface=public, service_id=9e8fc82085494cb290453f80f3845ae2, region_id=RegionOne) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:37.146956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.148563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.158065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 456/906] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:36 2022] GET /identity/v3/endpoints?service_id=9e8fc82085494cb290453f80f3845ae2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:37.161329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.202966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa44b1-45c2-4f81-b3d7-e891cf303aac None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.224924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:37.241377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.241377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.241377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.241377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.252174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.253653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.270300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196c733-8235-40d4-86de-1fabd30a8d18 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:37.270981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:37.271891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:37.272767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:37.272767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:37.272767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:37.276917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 451/907] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:37.277777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.310947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.311924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.312520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.313107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.314716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.316386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.329128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 457/908] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:37 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:55:37.384181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:37.393468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471905-2261-43a4-a569-15e34e0df167 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.435584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.436211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.436490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.436764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.437461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:37.437762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.439499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.453671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 452/909] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:37.462074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.587836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b8d6a-4ac5-4644-b7c7-45d728f6c18e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.613167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:37.625814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.626452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.626733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.627014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.634250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.635699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-d76733ba-9ff2-48de-bb97-9d295ad28692 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:37.647283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:37.648173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:37.649161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 458/910] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:37.654933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.765636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3bfed-8271-4492-b7b4-bae6537f2552 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.765960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3bfed-8271-4492-b7b4-bae6537f2552 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.766198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3bfed-8271-4492-b7b4-bae6537f2552 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.767655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 459/911] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:37.767780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685c85-cc59-46b7-a400-617fbcdfa33b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.773547 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.774078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.774564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.794592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:37.796320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:37.804388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.805033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.805320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.805598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.806303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:37.806612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.808048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.821824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 453/912] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:37.828029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:37.844216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:37.880713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 460/913] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:37.940980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3206f43-d830-46b5-8cc6-03d4cf14e297 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:37.978629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:37.979664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:37.980094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:37.980631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:37.981534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] RBAC: Adding query filter params (role.id=c73c55366cc54d609b27a8475b843d42, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7236db7932e2438db1c71d596d1e17f4) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:37.982004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:37.983677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:37.990663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 454/914] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:37 2022] GET /identity/v3/role_assignments?user.id=7236db7932e2438db1c71d596d1e17f4&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c73c55366cc54d609b27a8475b843d42 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:38.169872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:38.320017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f33833-3c0a-474c-99de-e5474d6fd764 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:38.343865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:38.376985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:38.376985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:38.376985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:38.376985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:38.377430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:38.378804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-864d4a9c-c0d5-4bf4-8e3b-823d2940f1ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:38.390660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:38.391725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:38.393189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 461/915] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:38.401532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:38.431959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3b0df-d100-490d-b300-97292b18ed71 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:38.432618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3b0df-d100-490d-b300-97292b18ed71 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:38.433169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3b0df-d100-490d-b300-97292b18ed71 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:38.434997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 462/916] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:38.443321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:38.443925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:38.444490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:38.478906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:38.480472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:38.590926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:38.649881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 463/917] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:38.650262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996b3e-f1d3-4f20-a0fa-a7939d5e1705 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:38.704310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:38.705483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:38.706045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:38.706541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:38.708008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:38.708523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:38.710201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:38.725168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 455/918] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:38.731084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:38.880874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc4928-d055-44f4-a244-8f66c4ca281d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:38.891688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:38.917596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:38.918340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:38.918622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:38.919108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:38.919811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:38.920117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:38.921646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:38.927915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 464/919] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 30 00:55:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:38.933479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.046033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf99f42-f5ea-4a76-b79d-421cd9e5229c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.052967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.090357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:39.090985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.091272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.091554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.092239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:39.093849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:39.106585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:39.193016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46f5c-aa95-425a-b4b6-7a40450c8bad None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.227808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 456/920] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:39.242769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:39.243538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.243822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.244094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.244709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:39.246424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-7a3ee3a0-6680-4a10-8568-75402757a2be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:39.257909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:39.258994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:39.259853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 465/921] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:39.268521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.398878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c74c7-9156-4264-80c2-d2bc5c56a6e8 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.429787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c5ccc-3368-4d3c-90cd-7a55c5b7bed2 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.430317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c5ccc-3368-4d3c-90cd-7a55c5b7bed2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.430317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c5ccc-3368-4d3c-90cd-7a55c5b7bed2 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.431832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 466/922] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:39.434742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:39.435363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.435647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.435917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.436549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:39.436653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.436849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:39.436981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.437224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.438496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:39.444865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 457/923] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:39.450419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.461326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:39.462478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:39.502249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:39.521134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:39.563482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6cd8d-10e8-4cc0-94ed-2b4ea2a70e17 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.571201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 467/924] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:39.602192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:39.602817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.603109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.603396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.604042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:39.604357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:39.605967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:39.611969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 458/925] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:39.618238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.728644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1fc40-5c4d-45fe-a26c-218e04e96250 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.770092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:39.770843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.771134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.771520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.772245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] RBAC: Adding query filter params (interface=public, service_id=dd2d4001d268434188d5974c2d754a03, region_id=RegionOne) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:39.772557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:39.773989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:39.779858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 468/926] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:39 2022] GET /identity/v3/endpoints?service_id=dd2d4001d268434188d5974c2d754a03&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:39.785637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.853410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:39.883283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:39.903406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0544bd-1a9b-40e4-832f-0c9c47d2a1e4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.941946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:39.952846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:39.953841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:39.954306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:39.955314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:39.956456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:39.959541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:39.968365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefd9a-5ee4-4cf1-8f7c-db6bd1e1307c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:39.973341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 459/927] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:39 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:55:40.013276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:40.014288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.014720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.015159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.015900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:40.017660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-746cb4af-2157-412d-ba5a-3bee3dbb7800 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:40.028575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:40.029689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:55:40.030567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:40.033227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 469/928] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 30 00:55:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:40.043715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:40.186565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246b90-8f9b-45df-b5c8-79ea39fdd4d4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:40.237883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574a3e-cc65-4caf-904b-2ff2cd0a66f3 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.238802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574a3e-cc65-4caf-904b-2ff2cd0a66f3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.239653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574a3e-cc65-4caf-904b-2ff2cd0a66f3 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.241372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 470/929] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:40.246696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.246987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.247269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.248559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:40.249927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.250650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.251370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.252777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:40.253546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:40.257540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:40.266648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 460/930] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:40.272401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:40.273812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:40.275284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:40.330405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:40.358713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 471/931] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:40.390941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422567-9fb4-4c5c-b639-6c0d23cdcaab None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:40.435253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:40.436702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.437236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.437747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.438851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:40.439363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:40.441143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:40.447275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 461/932] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:40.458187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:40.492240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:40.596358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aa4f3-69aa-4795-842f-56af88185576 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:40.652421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:40.653781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:40.654409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.654693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.654975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.655656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:40.657317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:40.792350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 472/933] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:55:40.803247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66927c8-8c35-4046-84df-703a634a5d26 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:40.828286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:40.860928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:40.861656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:40.863848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:40.863848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:40.879861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:40.886453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:40.887472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:40.888312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:40.889674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 462/934] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 30 00:55:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:40.898332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:40.999861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:41.026079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc205-a4b6-4975-b643-9789e729175f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:41.067030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:41.067596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.068070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.068352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.069072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:41.069767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:41.071886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:41.081537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 473/935] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:55:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:41.087415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.210993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f9d9f-e5df-46cf-85c2-eab9fc838528 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:41.249711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:41.250347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.250629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.250907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.262809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:41.264260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-4062a204-fbe3-41fa-8a8d-252988461dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:41.280006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:41.281033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:41.282089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:41.282089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:41.282089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:41.282089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 463/936] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:41.290165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.402084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc07cd-2f0b-42b7-bdc5-a9eca821ae5c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:41.438001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:41.438870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.439150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.439426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.440073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:41.440376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:41.441800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:41.449890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:41.455296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912719-316a-4d13-8360-6a98aebddf46 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.455804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912719-316a-4d13-8360-6a98aebddf46 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.455910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912719-316a-4d13-8360-6a98aebddf46 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.456167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 474/937] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:41.458240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 464/938] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:41.462663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.463722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.470048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.470048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.495127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:41.496879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:41.527002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:41.602511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e642-a6f0-4b77-8cbf-eaa7483be1d9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:41.602725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 465/939] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:41.652573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:41.653156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.653443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.653734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.664960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:41.667668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:41.683876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:41.685746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:41.687016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 475/940] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:55:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:41.697364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.832921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fe8e-04f9-43b5-8d94-9b5b140ac4c4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:41.874326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:41.875325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:41.875807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:41.876291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:41.877270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:41.877777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:41.880014 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:41.904689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 466/941] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 30 00:55:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:41.908436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.949747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:41.966407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:41.999571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:42.055367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e823-b63f-440a-a479-414a2831aca2 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.092361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41b35-5c8f-4eb0-946d-816c8c7d7e65 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.116662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.117461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.117749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.118030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.132809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.134795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.153982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.154612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.154949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.155174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.155849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.157315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.159954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING keystone.server.flask.common [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:42.160096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:42.161119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:42.162484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:42.162484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:42.162484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:42.162484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 476/942] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:42.168781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:42.212512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.sql.core [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:55:42.212512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:55:42.212512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [parameters: {'id': 'ea476c5afe5141a99ac8bcab4829b258', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:55:42.212512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89119) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea476c5afe5141a99ac8bcab4829b258.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea476c5afe5141a99ac8bcab4829b258. Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:55:42.224067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result.read() Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 00:55:42.226199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application yield resource Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise self.value Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application session.commit() Aug 30 00:55:42.228360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:55:42.230363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:55:42.232355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application result.read() Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:55:42.235087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [parameters: {'id': 'ea476c5afe5141a99ac8bcab4829b258', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.239064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:42.241818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea476c5afe5141a99ac8bcab4829b258. Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 467/943] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 30 00:55:41 2022] POST /identity/v3/projects => generated 262 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:42.244989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:42.331753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:42.347318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1af272-e11b-4f87-80ce-7cf038b61566 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.366049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:42.384470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.385120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.385413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.385680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.386333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:42.386642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.388029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041201a-7de5-449c-b84e-665311afcb04 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.389238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163f00d-8ff5-4060-899c-45cb29cbcec3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.403323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 477/944] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:42.406909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24946db-d83c-4f60-8015-43762fca71c9 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.407464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24946db-d83c-4f60-8015-43762fca71c9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.408084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24946db-d83c-4f60-8015-43762fca71c9 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.409956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 478/945] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:42.410935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24946db-d83c-4f60-8015-43762fca71c9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:42.437428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.438066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.438610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.438887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.446208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.448208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-a9759857-8aeb-41e8-915b-4b57e9b4ddd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:42.464659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:42.466238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:42.467199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:42.472297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 468/946] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:42.473139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.473427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.473717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.496185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:42.497750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:42.545220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24946db-d83c-4f60-8015-43762fca71c9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.586860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.588745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.588745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.588895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 469/947] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:42.589013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.595214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:42.599415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.600908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:42.614488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:42.615691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:42.616593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 479/948] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:42.622193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:42.663961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:42.677344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:42.731377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d204b42-d40c-4627-8ab6-644600ee8754 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.766236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc74b3-abcc-4353-b971-ef6bb74ce77d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:42.777904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be255-2373-4386-8244-4159fd631d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.778538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be255-2373-4386-8244-4159fd631d16 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.778823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be255-2373-4386-8244-4159fd631d16 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.779104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be255-2373-4386-8244-4159fd631d16 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.779778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be255-2373-4386-8244-4159fd631d16 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:42.780089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be255-2373-4386-8244-4159fd631d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.781711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be255-2373-4386-8244-4159fd631d16 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.813729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 470/949] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:42.819935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:42.820575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.821048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.821340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.822189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:42.822501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:42.824066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d53f-7fa5-4443-9159-2beac9818761 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:42.839923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 480/950] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:42.846053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be255-2373-4386-8244-4159fd631d16 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:42.884651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164259-1abd-48e2-a593-ded052a57507 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.885024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164259-1abd-48e2-a593-ded052a57507 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.885246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164259-1abd-48e2-a593-ded052a57507 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.886762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 481/951] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:42.892350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:42.893424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:42.893913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:42.916965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:42.918198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:42.985357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be255-2373-4386-8244-4159fd631d16 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.008579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:43.012984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 482/952] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:43.013676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.036750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.037996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.038278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.038552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7236db7932e2438db1c71d596d1e17f4/roles/c73c55366cc54d609b27a8475b843d42` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.040760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=7236db7932e2438db1c71d596d1e17f4, role_id=c73c55366cc54d609b27a8475b843d42)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.042284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.052351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:43.125829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 471/953] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:55:42 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7236db7932e2438db1c71d596d1e17f4/roles/c73c55366cc54d609b27a8475b843d42 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:55:43.149916 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ee6bf-314b-40bf-9ff7-ef9d8a43b694 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.205592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.206231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.206521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.207411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.208738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.210202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:43.220349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:43.221580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:43.223160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 483/954] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:43.230879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.303972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.397073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:43.414275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4699c-4749-44e2-919d-ee762b8559a6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.430601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee017bed-e43b-4383-a3cb-c7f9e0788f62 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.453434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.454192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.454519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.454861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] PATH_INFO: `/v3/services/compute` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.455579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.457325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:43.467143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:43.468376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:43.469498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:43.474943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 484/955] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:43.476339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.486212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.487396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.487924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.489025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.489867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:43.490405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.491943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.498129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 472/956] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:43.507279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.585564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:43.586704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88c10-06a7-48d0-af01-f2dbe9cedb07 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.634470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.635162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.635442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.635771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.636412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:43.636768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.638190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.649345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 485/957] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:43.649532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ad54e-0984-4ea0-a18d-5717ecd25d4e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.650276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.665967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:43.690722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.693363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.693808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.694237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.695415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:43.695888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.698078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.709011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 473/958] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:43.717055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:43.764530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b3368-1579-43ae-9532-6ea53fd97221 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.801835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.802740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.803171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.803593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.804414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] RBAC: Adding query filter params (type=compute) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:43.804720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.806186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9bd97-c7b8-460d-9f46-da53d477b64f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.816966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 486/959] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:43.849775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49327ab-305f-446e-bffc-8a54d76067f8 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:43.869541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:43.890668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87104a70-7421-4a91-863d-f50dc2ac5dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:43.891294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104a70-7421-4a91-863d-f50dc2ac5dcd None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:43.891576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104a70-7421-4a91-863d-f50dc2ac5dcd None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:43.891852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87104a70-7421-4a91-863d-f50dc2ac5dcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:43.892533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87104a70-7421-4a91-863d-f50dc2ac5dcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:43.894006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87104a70-7421-4a91-863d-f50dc2ac5dcd None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:43.983085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 474/960] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:55:44.978145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc1bc7-b241-4ea1-940b-e50ec6edcc6a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.978640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc1bc7-b241-4ea1-940b-e50ec6edcc6a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.978891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc1bc7-b241-4ea1-940b-e50ec6edcc6a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:44.981517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 487/961] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:44.989763 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762665-fe54-4c1e-8b0f-6cffa9e1aae9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:44.990257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762665-fe54-4c1e-8b0f-6cffa9e1aae9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:44.990332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762665-fe54-4c1e-8b0f-6cffa9e1aae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.015792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d3762665-fe54-4c1e-8b0f-6cffa9e1aae9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:45.017656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d3762665-fe54-4c1e-8b0f-6cffa9e1aae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:45.113650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 475/962] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:45.178654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc444137-4b82-4d05-aa78-09abe18c4854 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:45.179149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc444137-4b82-4d05-aa78-09abe18c4854 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:45.179527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc444137-4b82-4d05-aa78-09abe18c4854 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.181145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 488/963] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:45.187764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:45.188915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:45.189741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.209542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:45.211065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:45.290488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 476/964] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:45.416342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc444137-4b82-4d05-aa78-09abe18c4854 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:45.538579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:45.565742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc444137-4b82-4d05-aa78-09abe18c4854 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:45.604768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:45.607193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:45.607808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:45.608090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:45.608366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.609061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:45.610506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:45.613630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING keystone.server.flask.common [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:55:45.635609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:45.656551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.sql.core [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:55:45.656551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:55:45.656551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [parameters: {'user_id': 'c298419eba854354a913a74b3d2534b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:55:45.656551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=89118) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application result.read() Aug 30 00:55:45.687369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:55:45.688631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application yield resource Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise self.value Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application session.commit() Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:55:45.690125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:55:45.691008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:55:45.703007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application result.read() Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:55:45.703876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c298419eba854354a913a74b3d2534b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:45.704705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 00:55:45.705545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 489/965] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 30 00:55:45 2022] POST /identity/v3/users => generated 160 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:45.706452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:45.765600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6d419-34ca-4bdf-b978-411f80259cef None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:45.807856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:45.808953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:45.809594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:45.810089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.830855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:45.839361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:45.840334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:45.841221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:45.848162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70457940-caaf-4186-bf63-dcb22e236292 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:45.848761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 477/966] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 30 00:55:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:45.850206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:45.888879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:45.890146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:45.891008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:45.891601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:45.901915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:45.904284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:45.907131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:45.925748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:45.926866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:55:45.928025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:45.934264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 490/967] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:45.937556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:45.959111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:45.986037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3404b-781c-45c3-b8b0-e1d33e5a37c5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.034321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.035899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.036414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.036857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.037713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:46.038029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.039547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df464330-27f9-41d7-92f5-e7a9c626e494 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.050939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 478/968] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:55:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:46.053563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541addda-52f9-4222-85bb-09c8c8e9257e None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.053563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541addda-52f9-4222-85bb-09c8c8e9257e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.053985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541addda-52f9-4222-85bb-09c8c8e9257e None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.055390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 479/969] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:46.058020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541addda-52f9-4222-85bb-09c8c8e9257e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.073283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a215236-25f9-4958-a7d9-c129b19d681e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.133151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.133677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.133964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.134243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.134963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:46.135271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.137793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e892a-2d3b-4d39-abd2-9a80cd6ee2f0 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.185784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 491/970] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 30 00:55:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:46.187123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045699e5-88c2-465c-80d7-338390d05ce8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.187416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045699e5-88c2-465c-80d7-338390d05ce8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.187699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045699e5-88c2-465c-80d7-338390d05ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.194211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541addda-52f9-4222-85bb-09c8c8e9257e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.208027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-045699e5-88c2-465c-80d7-338390d05ce8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:46.209799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-045699e5-88c2-465c-80d7-338390d05ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:46.250374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.251127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.251469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.251812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.264726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.269114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.271431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.278077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0d9651bd-e6ae-4540-af80-0155684668b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:46.291147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:46.299629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 480/971] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab070-4241-40a1-9d17-e6cdaced3fb9 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab070-4241-40a1-9d17-e6cdaced3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab070-4241-40a1-9d17-e6cdaced3fb9 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 481/972] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:46.301410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ab070-4241-40a1-9d17-e6cdaced3fb9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.310393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 492/973] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:46.311950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.312294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.312636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.337696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:46.339359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:46.447902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 493/974] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:46.459749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ab070-4241-40a1-9d17-e6cdaced3fb9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.499575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.500285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.500690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.501124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.501851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:46.502237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.504359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.532971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 482/975] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:46.534313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.592621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.658104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e64c-7aeb-4bd0-8e6c-9846485276f7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.681718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.683772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.710160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.710724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.711008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.711280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.718681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.720135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.731094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504c01-2f40-4345-9807-5d36ff9e83bd None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:46.734042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:46.735258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:55:46.736521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:46.737341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 494/976] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:46.738744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.770839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.771460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.771744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.772024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.772679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.774084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.838605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc6551-0eb7-4029-8645-946941ffce3a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:46.861711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 483/977] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:46 2022] POST /identity/v3/services => generated 242 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:46.862533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.884704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:46.885563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:46.885676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:46.885959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:46.886574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:46.888038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:46.899525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:46.900642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:46.901878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 495/978] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:46.906817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:46.950133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:46.994017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205db22e-3f2a-4778-89a8-a4f4f2bc4547 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.013320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.033041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce890-f353-4a3a-a82d-f1141a4027e3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.041991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.047894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.047894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.047894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.047894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:47.047894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.047894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.071226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 484/979] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:47.077383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.082539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.082539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.082539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.082539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.083269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:47.083269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.083269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.087426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 496/980] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:47.093216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.199345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f2e5-3770-47aa-a111-04fa3887c334 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.209053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.213319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126e657-38af-44ba-afe4-9317da48d180 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.240047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.240673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.241036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.241292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.254418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.255150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.255440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.255720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.256416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:47.256665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.258215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.265182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 497/981] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:47.270122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.286737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.322574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.324458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.392738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f386ba-c4a1-4cbb-ae9d-265f0b38e0ca None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.437149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.437773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.438317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.438600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.439321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] RBAC: Adding query filter params (interface=admin, service_id=dd2d4001d268434188d5974c2d754a03, region_id=RegionOne) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:47.439631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.441588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.448982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 485/982] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:55:47.452178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 498/983] 10.222.0.16 () {56 vars in 1249 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/endpoints?service_id=dd2d4001d268434188d5974c2d754a03&interface=admin®ion_id=RegionOne => generated 193 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:47.452796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.458786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.504212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.551083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.588643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7def4ef-7082-43b6-9669-1ff2c7bcc31c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.592622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f01b61-1258-49bd-8048-485f46312c97 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.628041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.629544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.629937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.630019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.631452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.632335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.632738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.633111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.633726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.635100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.642623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.653274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 499/984] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:55:47.653428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:47.669502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:47.670726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:47.671812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:47.671812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:47.671812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:47.671812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 486/985] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:47.678694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.783386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:47.793679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a0d01-5d21-424a-a891-007fe47c7f98 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:47.840236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:47.841062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:47.841584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:47.841584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:47.842176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:47.842431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:47.843806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:47.855832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 500/986] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:47.862244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:47.978266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065aa451-634b-4418-a6c1-b3dc4fb89401 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:48.004840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:48.019872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:48.021150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:48.021150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:48.021344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:48.028828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:48.030309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:48.042490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:48.043802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:48.044705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:48.045678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 487/987] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:48.049774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:48.178985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff9776-bfc7-4a3e-bcb5-a783eb70c05b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:48.243419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:48.244487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:48.244981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:48.245480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:48.246846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:48.247406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:48.250313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a4494-2acd-4cbd-93ba-dea3549595b4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:48.279550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 501/988] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:48.280861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:48.389859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845841-dfa3-4e58-af57-d72c20013a8b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:48.428609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:48.429557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:48.430038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:48.430529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:48.431664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] RBAC: Adding query filter params (role.id=c73c55366cc54d609b27a8475b843d42, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7236db7932e2438db1c71d596d1e17f4) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:48.432022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:48.433484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e200-f46a-4d59-b65a-60f478702ee1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:48.445161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 488/989] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:48 2022] GET /identity/v3/role_assignments?user.id=7236db7932e2438db1c71d596d1e17f4&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c73c55366cc54d609b27a8475b843d42 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:48.939183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89401f5-e1b6-4847-8080-a8541fa1f082 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:48.939698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89401f5-e1b6-4847-8080-a8541fa1f082 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:48.940135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89401f5-e1b6-4847-8080-a8541fa1f082 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:48.942877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 502/990] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:48.951282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:48.951754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:48.952240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:48.975864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:48.977104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:49.024740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:49.053376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 489/991] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:49.329831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89401f5-e1b6-4847-8080-a8541fa1f082 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:49.347832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:49.476124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89401f5-e1b6-4847-8080-a8541fa1f082 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:49.537942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:49.538948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.539426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.539881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.540885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:49.543376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-625a5554-ec1f-4064-8134-189079e1fa27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:49.559151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:49.560217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:49.561510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 503/992] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:49.568990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:49.665977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d3489-f01d-436f-b1fd-8e77fee8ecd2 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.666390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d3489-f01d-436f-b1fd-8e77fee8ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.667492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d3489-f01d-436f-b1fd-8e77fee8ecd2 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.671018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 504/993] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:49.676915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.677471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.677798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.696172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273352b6-9e61-4368-a7a5-00c99b955c8a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:49.698606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:49.699799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:49.740217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:49.740835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.741154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.741593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.742093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] RBAC: Adding query filter params (name=compute) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:49.742484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:49.744824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:49.758937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 490/994] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:49.761151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:49.800600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 505/995] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:49.824726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:49.906496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3f2f-d082-45cb-971a-b3e0b9876b4f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:49.959970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:49.960514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:49.960788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:49.961097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:49.961745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:49.962048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:49.963429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:49.977247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 491/996] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:49.979712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:49.993354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:50.116646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:50.139110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4903327-2d56-4bf0-a132-d63eaf447c21 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:50.200141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:50.200975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.201367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.201744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.202698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] RBAC: Adding query filter params (interface=public, service_id=118380e70c114f1db478b29b38f6eb27, region_id=RegionOne) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:50.203252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:50.205475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:50.220010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 506/997] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:49 2022] GET /identity/v3/endpoints?service_id=118380e70c114f1db478b29b38f6eb27&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:50.221510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:50.295928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7ca0-99d4-4e76-ad1c-dfc2a6f453f5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:50.298722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:50.347500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:50.351220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:50.351881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.352175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.352692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.353717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:50.355364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:50.365521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:50.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:55:50.368080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:50.372165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 492/998] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 30 00:55:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:50.373137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:50.396733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c7fae-11d5-4f36-a657-dcd3f560e545 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:50.448108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ff6e-12dc-4222-ad5c-039f78b6e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:50.448741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ff6e-12dc-4222-ad5c-039f78b6e041 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.449052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ff6e-12dc-4222-ad5c-039f78b6e041 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.449336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ff6e-12dc-4222-ad5c-039f78b6e041 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.450028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ff6e-12dc-4222-ad5c-039f78b6e041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:50.451430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ff6e-12dc-4222-ad5c-039f78b6e041 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:50.466063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 507/999] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:50 2022] GET /identity/v3/services => generated 1727 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:55:50.565395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3f3aa-ba64-4918-a209-6a6dec6cfe37 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:50.610725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:50.611436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.611725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.612061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.613427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:50.613768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:50.615181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:50.623445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 493/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:50.625724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e6ab-c69a-4fe3-a1e1-f0cccfbbd105 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.626167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e6ab-c69a-4fe3-a1e1-f0cccfbbd105 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.626556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e6ab-c69a-4fe3-a1e1-f0cccfbbd105 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.629584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 508/1001] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:50.633654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:50.643629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.644597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.645969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.675749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:50.677279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:50.699988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:50.790978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 509/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:50.811586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298a18b-6c9b-42a0-9266-3c2a8cfd5847 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:50.861965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:50.862673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:50.862955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:50.863755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:50.864618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:50.865088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:50.866613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:50.872999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 494/1003] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 30 00:55:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:50.881457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:50.981515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:51.028643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb8e2e-d66f-446e-a60e-89d4b7cbde1b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:51.087113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:51.087661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:51.087950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:51.088226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:51.088912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:51.091941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:51.119236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:51.162299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 510/1004] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:51.306963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:51.321940 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40b71-d419-4d62-ad70-51a9f821cc78 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:51.376266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:51.376806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:51.377121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:51.377397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] PATH_INFO: `/v3/services/image` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:51.377980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:51.379676 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:51.389062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:51.390342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:51.392133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 495/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 30 00:55:51 2022] GET /identity/v3/services/image => generated 86 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:51.397778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:51.545763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853ea80-d0e2-42aa-9fd2-54f6c685dbb6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:51.574013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:51.586083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:51.586699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:51.595465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:51.595465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:51.595465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] RBAC: Adding query filter params (name=image) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:51.595465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:51.595465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07db181-1223-4c84-997c-32e6f4ac7baa None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:51.595465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 511/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:51.601248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:51.746592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6efc33-8004-4079-9584-14a900a14998 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:51.793440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:51.794057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:51.794354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:51.794617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:51.795254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:51.795560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:51.796969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196683a-c3e0-45ec-ab38-15aed78241a8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:51.801925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 496/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:52.619107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b82f-42ad-432a-b24a-249715f920c0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:52.619634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b82f-42ad-432a-b24a-249715f920c0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:52.619634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b82f-42ad-432a-b24a-249715f920c0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:52.621080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 512/1008] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:52.626590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:52.627146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:52.627146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:52.645863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:52.647064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:52.667570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:52.730361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 497/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:53.004142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b82f-42ad-432a-b24a-249715f920c0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:53.160481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b82f-42ad-432a-b24a-249715f920c0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.208824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:53.209851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.210135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.210423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] PATH_INFO: `/v3/services/compute` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.211136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:53.213451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-77b99119-3a0d-40fa-86c4-4422c0a7b116 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:53.224357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:53.225483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:53.229953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 513/1010] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:53.232393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:53.243361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3201b4-df98-413d-9c56-0aa15f1c3e4e None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.243646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3201b4-df98-413d-9c56-0aa15f1c3e4e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.243920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3201b4-df98-413d-9c56-0aa15f1c3e4e None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.245588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 514/1011] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:53.251299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d90181-bf70-4e37-b193-89c825938272 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.251574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d90181-bf70-4e37-b193-89c825938272 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.251853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d90181-bf70-4e37-b193-89c825938272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.272591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-80d90181-bf70-4e37-b193-89c825938272 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:53.273778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-80d90181-bf70-4e37-b193-89c825938272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:53.352874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:53.397456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 515/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:53.403770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b0b04-eabe-4ed1-bb6f-f5ed4a378f9d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.460046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:53.460688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.461137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.461578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.462618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] RBAC: Adding query filter params (name=compute) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:53.463137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:53.465559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:53.479586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 498/1013] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:53.480451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d90181-bf70-4e37-b193-89c825938272 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:53.605305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d90181-bf70-4e37-b193-89c825938272 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.642402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:53.643042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.643301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.643564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.644984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:53.645262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:53.646711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:53.656967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 516/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 30 00:55:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:53.658614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:53.672002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:53.681336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:53.732123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:53.792540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bb3c0-e94f-4d33-bdf0-8f0b5794c6c6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.796552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603c8fc-f11f-481b-9bfd-b4fc75f68609 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.836293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e0d5-de55-45bc-bea9-fae6e564c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:53.837152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc40656-7a8f-4fc1-9127-490b828b2825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:53.837560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e0d5-de55-45bc-bea9-fae6e564c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.837765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc40656-7a8f-4fc1-9127-490b828b2825 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.838057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc40656-7a8f-4fc1-9127-490b828b2825 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.838332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc40656-7a8f-4fc1-9127-490b828b2825 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.838571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e0d5-de55-45bc-bea9-fae6e564c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.839009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc40656-7a8f-4fc1-9127-490b828b2825 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:53.839268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e0d5-de55-45bc-bea9-fae6e564c4a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.840371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc40656-7a8f-4fc1-9127-490b828b2825 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:53.840783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e0d5-de55-45bc-bea9-fae6e564c4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:53.842403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e0d5-de55-45bc-bea9-fae6e564c4a8 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:53.844174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 517/1015] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:53.849170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42a9b0-3da7-4a4b-be25-90e543c5033e None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.849583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42a9b0-3da7-4a4b-be25-90e543c5033e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.849923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42a9b0-3da7-4a4b-be25-90e543c5033e None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.852213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 518/1016] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:53.852976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42a9b0-3da7-4a4b-be25-90e543c5033e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:53.970173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42a9b0-3da7-4a4b-be25-90e543c5033e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:53.970799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 499/1017] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:55:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:53.972047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:53.972339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:53.972685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:53.999138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:54.000218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:54.001721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:54.035510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5896e7e-5749-473b-b9ba-67f58b24fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:54.037397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896e7e-5749-473b-b9ba-67f58b24fa6b None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:54.037969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896e7e-5749-473b-b9ba-67f58b24fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:54.039602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5896e7e-5749-473b-b9ba-67f58b24fa6b None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:54.040300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5896e7e-5749-473b-b9ba-67f58b24fa6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:54.042238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5896e7e-5749-473b-b9ba-67f58b24fa6b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:54.085821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:54.090928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 500/1018] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:53 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:54.138650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 519/1019] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:53 2022] POST /identity/v3/projects => generated 311 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:54.397877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:54.525614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafcc73-3d4f-4c39-991e-7765a083d364 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:54.573073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ee85-de26-4cc3-908b-ef6e538fa372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:54.573695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ee85-de26-4cc3-908b-ef6e538fa372 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:54.573974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ee85-de26-4cc3-908b-ef6e538fa372 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:54.574251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ee85-de26-4cc3-908b-ef6e538fa372 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:54.574968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3ee85-de26-4cc3-908b-ef6e538fa372 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:54.576361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3ee85-de26-4cc3-908b-ef6e538fa372 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:54.704837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 501/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:55:54 2022] POST /identity/v3/services => generated 242 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:56.139986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936eeff-94c1-4214-a1ea-42bd9567fda8 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.140884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936eeff-94c1-4214-a1ea-42bd9567fda8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.140884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936eeff-94c1-4214-a1ea-42bd9567fda8 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.142135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 520/1021] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:56.147729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.148279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.148279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.169369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:56.170550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:56.175732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ac8d-25a4-47a9-8535-9801a2d4a370 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.175954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ac8d-25a4-47a9-8535-9801a2d4a370 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.176232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830ac8d-25a4-47a9-8535-9801a2d4a370 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.177620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 521/1022] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:56.184514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.184912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.185260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.203765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:56.205086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:56.254974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:56.280719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 502/1023] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:56.294687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 522/1024] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:55:56.560583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:56.570957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:56.682960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de82b2-d758-4700-b19b-33adc1037275 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:56.687509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:56.702923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbea5c8-e758-4075-815b-58721726e50e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:56.726637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d7e05-b813-4097-aacb-54457f64766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:56.727284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7e05-b813-4097-aacb-54457f64766e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.727570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7e05-b813-4097-aacb-54457f64766e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.727849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7e05-b813-4097-aacb-54457f64766e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.739644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d7e05-b813-4097-aacb-54457f64766e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-773d7e05-b813-4097-aacb-54457f64766e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:56.745065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:56.746043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 503/1025] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 30 00:55:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:56.746944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefddd39-455c-4e34-901e-61082ebf4fad None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.747758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefddd39-455c-4e34-901e-61082ebf4fad None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.747758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefddd39-455c-4e34-901e-61082ebf4fad None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.750762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 504/1026] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:55:56.754458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefddd39-455c-4e34-901e-61082ebf4fad None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:56.755532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec88037-2060-4e6b-9f22-2adb73483333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:56.756173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec88037-2060-4e6b-9f22-2adb73483333 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.756454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec88037-2060-4e6b-9f22-2adb73483333 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.756727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec88037-2060-4e6b-9f22-2adb73483333 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.757853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec88037-2060-4e6b-9f22-2adb73483333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:56.759300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec88037-2060-4e6b-9f22-2adb73483333 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:56.761017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 523/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:56.762064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.762437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.762726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.785943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:56.787048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:56.816529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:56.878289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 524/1028] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:56.879059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:56.891663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefddd39-455c-4e34-901e-61082ebf4fad None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:56.937315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:56.938497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:56.938782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:56.939064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:56.939737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:56.940042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:56.942234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:56.951257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 505/1029] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:55:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:56.958332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.021880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:57.033147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c088b9-1a68-480b-ac4b-26a24155efc4 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.073419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.073951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.074233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.074621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.075317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.076803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.088547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25357af-241c-476a-b2ad-3206f5dab900 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.102354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:57.129200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.129915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.130199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.130481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.141913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.143351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:57.157864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:57.160090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:57.161942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:57.161942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:57.161942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:57.161942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 506/1030] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:55:57.161942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.224162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 525/1031] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:55:56 2022] POST /identity/v3/users => generated 285 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:55:57.225043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.275359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fba8ad-f430-4dc6-a0f9-bdd292634a50 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.337684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.338893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.339276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.339647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] PATH_INFO: `/v3/services/image` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.340175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.341678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:57.352204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:57.353403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:57.354290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 507/1032] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:57.359664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.396915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf731ec-46f4-4cc5-9ea5-9109693b3580 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.401975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:57.442824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.443449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.443732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.444020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.444675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:57.445037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.446433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.464966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 526/1033] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:57.469274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.479044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:57.516164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ab9d-8acf-4863-98d1-4cccfddbb7ca None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.556997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.557624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.558394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.558671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.559319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:57.559627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.561069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.567202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 508/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:57.572900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.614503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b683ec-0dfe-452d-aed4-c264b23eaf7e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.664018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.665214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.665724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.666364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.684692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.688672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.690289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:55:57.700218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:57.706976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:55:57.708095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 527/1035] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:57.708768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a637d-4802-40de-a11b-a75f5ebb99e8 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.708845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.746307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.746924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.747277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.747561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.748203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] RBAC: Adding query filter params (type=image) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:57.748509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.749910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.756924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 509/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:57.763540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.794166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:57.846561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2ffdf-c219-4d6b-84d3-ce79d7154a17 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.885979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ea183-b44c-416a-93a6-bed4d685916c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:57.899384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.900975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.900975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.900975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.901373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:57.901646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.903105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.922775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 528/1037] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:57.930314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.947001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:57.947627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:57.947912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:57.948226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:57.949063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] RBAC: Adding query filter params (interface=public, service_id=1e4bd23588fa486584a2d83aafdd4f36, region_id=RegionOne) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:57.949587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:57.950803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:57.957893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 510/1038] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/endpoints?service_id=1e4bd23588fa486584a2d83aafdd4f36&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:57.963521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:57.986008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:58.058666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a749f1-f42f-43ee-baaa-87f52351eacc None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:58.086912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:58.103155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:58.103933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:58.104565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:58.104861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:58.115537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1378-f8b8-45a3-a81f-f13e0d0de064 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:58.156487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:58.157150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:58.157433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:58.157707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:58.158312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:58.159727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:58.177190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 511/1039] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/services => generated 1957 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:55:58.199152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:58.200814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:58.353048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 529/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:55:57 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:55:58.355832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:58.470695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:58.496074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce66bd-970e-4b1a-8378-ba5b375c9c94 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:58.545064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:58.545713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:58.545996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:58.546275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:58.557531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:58.559009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:55:58.575971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:58.577531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:55:58.578429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:55:58.578429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:55:58.578429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:58.578429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 512/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:58.583098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:58.611524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:58.705425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dce2f9-3ed5-4f9a-ada6-23839f91a8af None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:58.751110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:58.751916 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:58.752309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:58.752527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:58.753894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:58.755599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:58.757037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:58.771084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 530/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:58.776711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:58.900727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61f12-1b7c-4d91-ac0e-298ad6afc31f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:58.935908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:58.944263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:58.944914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:58.950232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:58.950232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:58.953327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:58.954811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:55:58.968871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:58.970262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:58.971146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 513/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:58.975996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:59.074477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:59.090787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf704e64-ba93-42a0-9455-b38be03f08c7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:59.133718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:59.134713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:59.135204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:59.135688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:59.137051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:59.137566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:59.139183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30ae14-40ba-4f53-9fed-ffc16b4085cb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:59.154930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 531/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:55:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:55:59.162282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:59.277989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b64a0-880f-4de7-9cb7-68ef2b6cc9b1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:59.309696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade435-d3ce-451c-a82a-456214c56698 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:59.310010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade435-d3ce-451c-a82a-456214c56698 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:59.310252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade435-d3ce-451c-a82a-456214c56698 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:59.311823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 532/1045] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:55:59.317940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:59.318231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:59.318670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:59.337330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:59.338247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:59.338652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:55:59.338773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:59.339212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:59.339964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:55:59.340562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] RBAC: Adding query filter params (role.id=c73c55366cc54d609b27a8475b843d42, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=e3083107d17b4596b7b858df7fc50147) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:55:59.341141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:55:59.343797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:55:59.359240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 514/1046] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:55:59 2022] GET /identity/v3/role_assignments?user.id=e3083107d17b4596b7b858df7fc50147&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c73c55366cc54d609b27a8475b843d42 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:55:59.423742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 533/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:55:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:59.702843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:59.767186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:59.821476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca82a-2109-4a49-94d5-95887dceb0d6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:55:59.865701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:55:59.866342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:55:59.866626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:55:59.866907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:55:59.884680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:55:59.892268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:55:59.893412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:55:59.895848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:55:59.899527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 515/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:55:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:55:59.900879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:55:59.983160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:00.009595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cf07-8117-4148-9f6a-077436c9801f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:00.047639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:00.048269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:00.048620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:00.048989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:00.049835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:00.050149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:00.051555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:00.061538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 534/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:00.067959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:00.183219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20f33-45e2-492b-8867-4ee5269423c2 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:00.203516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:00.229660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa3d9b-e5aa-424a-868a-888bfb2cd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:00.230297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3d9b-e5aa-424a-868a-888bfb2cd77e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:00.232787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3d9b-e5aa-424a-868a-888bfb2cd77e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:00.232787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3d9b-e5aa-424a-868a-888bfb2cd77e None admin] PATH_INFO: `/v3/users/54eeac0fdc2d4475bf2a27e9c3c6e109` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:00.254720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa3d9b-e5aa-424a-868a-888bfb2cd77e None admin] RBAC: Authorizing `identity:get_user(user_id=54eeac0fdc2d4475bf2a27e9c3c6e109)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:00.257410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa3d9b-e5aa-424a-868a-888bfb2cd77e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:00.266344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 516/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:00 2022] GET /identity/v3/users/54eeac0fdc2d4475bf2a27e9c3c6e109 => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:00.266570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:00.420094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc329433-6445-4ffb-b513-ca2a39fb3186 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:00.462474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:00.463528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:00.463528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:00.463818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:00.468287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:00.475019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162fd82-3c3c-4f4e-966e-e68a6f331514 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:00.475487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162fd82-3c3c-4f4e-966e-e68a6f331514 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:00.475748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162fd82-3c3c-4f4e-966e-e68a6f331514 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:00.477329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 517/1051] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:56:00.483168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:00.483513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:00.483856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:00.510666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:00.512698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:00.570068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:00.571547 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:00.608926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 518/1052] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:00.718097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 535/1053] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:00.724351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:00.859557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973d98f-665a-4bae-a821-9e146de49a82 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:00.863883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:00.894164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:00.922459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:00.923521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:00.924008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:00.924500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:00.926518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] RBAC: Authorizing `identity:get_project(project_id=321d375fcb044885b3027e621f87aa85)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:00.929229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:00.937121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 519/1054] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:00 2022] GET /identity/v3/projects/321d375fcb044885b3027e621f87aa85 => generated 311 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:00.938469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:00.942315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:01.022145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8542128-50a0-4f8f-a794-52ce05acac6b None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:01.066798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:01.067533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d9aa-ce11-4d36-b86e-504b300bf338 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:01.067891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.068331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.068771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] PATH_INFO: `/v3/services/image` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.069600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:01.071206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:01.081810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:01.083285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:56:01.084252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:01.091420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 536/1055] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 30 00:56:00 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:01.092584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:01.108433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:01.109095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.109405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.109718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.110406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=321d375fcb044885b3027e621f87aa85, user.id=54eeac0fdc2d4475bf2a27e9c3c6e109) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:01.110715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:01.112962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:01.128966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 520/1056] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:00 2022] GET /identity/v3/role_assignments?user.id=54eeac0fdc2d4475bf2a27e9c3c6e109&scope.project.id=321d375fcb044885b3027e621f87aa85&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:01.217259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:01.220727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1da7-363e-4e99-b42c-8a9270d43d80 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:01.262982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:01.263991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.264488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.265017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.265978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] RBAC: Adding query filter params (name=image) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:01.266291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:01.267670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48812f5-7aeb-4acf-b714-896e87c40dbe None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:01.275124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 537/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:01.281148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:01.319455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:01.390484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25ebd1-ff65-47b3-a060-e13a4a0ae928 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:01.408543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a5dc-e1bd-4755-b2a9-2f56bf4e6c5d None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.408836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a5dc-e1bd-4755-b2a9-2f56bf4e6c5d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.409733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a5dc-e1bd-4755-b2a9-2f56bf4e6c5d None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.411261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 538/1058] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:56:01.416378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.416668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.416966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.431778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:01.432682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.433206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.433663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.434503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] RBAC: Adding query filter params (type=image) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:01.435068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:01.435605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:01.436878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:01.437334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:01.444448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 521/1059] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:01.449768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:01.520180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 539/1060] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:56:01.570238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:01.573417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc22caa-02c8-4e1b-83a8-b4dad09a86dc None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:01.607563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:01.608182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.608457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.608729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.609421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:01.610776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:01.712619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 522/1061] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:56:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:01.790252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:01.897492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:01.904605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721b4a-f96b-4e54-b22f-73831ccf8264 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:01.947301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:01.947945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:01.948232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:01.948512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:01.959225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:01.964195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:01.965225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:01.966088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 540/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 30 00:56:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:01.971307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:02.075915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2bda9-a6ae-4382-ae68-3b44a885c561 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:02.113571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:02.114194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:02.114539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:02.114834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:02.115503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:02.115810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:02.117195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:02.130370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 523/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:56:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:02.132008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:02.241887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e1fc-0d73-434f-b902-9a8e9ad80ad1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:02.278703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:02.279343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:02.279628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:02.279902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:02.292962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:02.294903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:56:02.311159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:02.312252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:56:02.313460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:56:02.313460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:02.313460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:02.313460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 541/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:02.318494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:02.340493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:02.428230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b8c1a-3898-4d8e-b62b-c77b79261570 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:02.463188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:02.463876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:02.464158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:02.464432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:02.465111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:02.465419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:02.466783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:02.484167 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 524/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:02.485829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:02.489778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:02.601082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa903c32-f241-4923-bc2d-18fcb68650ef None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:02.636813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:02.637471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:02.637754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:02.638026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] PATH_INFO: `/v3/users/nova` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:02.646365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:02.647813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:56:02.660510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:02.661541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:56:02.662495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:02.665021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 542/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:56:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:02.667695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:02.753276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:02.777910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b3df-6fb6-4186-aa6d-5a08ab4b50f0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:02.822301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:02.822984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:02.826406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:02.826406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:02.826406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:02.826406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:02.826406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:02.847312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 525/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:56:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:02.853173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:02.918803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:02.959889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c90f76-b0d5-4870-a882-3f219b67871a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:02.996719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:02.997396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:02.997682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:02.997946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.009572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:03.011017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-6aa21c93-4694-4a4e-9a75-3f5706754403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:56:03.026035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:03.027204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:56:03.028168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:56:03.028168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:03.028168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:03.028168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 543/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:03.034741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.072873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9109a-953a-4762-a46c-fe9acc7c46d5 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.073289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9109a-953a-4762-a46c-fe9acc7c46d5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.073483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9109a-953a-4762-a46c-fe9acc7c46d5 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.074986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 544/1069] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:56:03.079838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.080148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.080403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.100799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:03.102031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:03.153933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790536a3-7e3f-4925-8d10-1942a8be7e7e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:03.181960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 545/1070] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:03.194469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:03.195091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.195445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.195731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.196383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:03.196698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:03.198101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:03.200641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:03.211557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 526/1071] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:03.217129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.265603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:03.322916 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547660ec-a4c1-4835-8b47-7c9b9ad821e7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:03.359132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:03.359766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.360053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.360331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.367884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:03.370674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:56:03.388229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:03.389237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:56:03.390144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:03.393264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 546/1072] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:03.395802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.456694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.525407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd6b41-b0f1-4c21-84be-d68bf523cf33 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:03.562598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:03.563469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.563754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.564029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.564725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:03.565072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:03.567101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:03.579309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 527/1073] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:03.585860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.595271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e70d3-11d3-48cd-948b-b36f3ec3e1f5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:03.600050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:03.638440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:03.639095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.639346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.639617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.653084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:03.654961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:03.660179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:03.661290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:03.662135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 547/1074] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:03.668530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.716439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae724b-6686-463c-8bc0-78005712757b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:03.754643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15dfce-0f54-45aa-86f4-8ff8d64768fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:03.755334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15dfce-0f54-45aa-86f4-8ff8d64768fc None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.755661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15dfce-0f54-45aa-86f4-8ff8d64768fc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.755944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15dfce-0f54-45aa-86f4-8ff8d64768fc None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/e3083107d17b4596b7b858df7fc50147/roles/c73c55366cc54d609b27a8475b843d42` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.759442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15dfce-0f54-45aa-86f4-8ff8d64768fc None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=e3083107d17b4596b7b858df7fc50147, role_id=c73c55366cc54d609b27a8475b843d42)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:03.760876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15dfce-0f54-45aa-86f4-8ff8d64768fc None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:03.797855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c1ecd-42b3-4ee9-adf1-fdcd668e1dff None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:03.847646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 528/1075] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:56:03 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/e3083107d17b4596b7b858df7fc50147/roles/c73c55366cc54d609b27a8475b843d42 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:56:03.847646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d950ba-0ad3-42e4-a644-eed17e8cbc54 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.847646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d950ba-0ad3-42e4-a644-eed17e8cbc54 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.847646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d950ba-0ad3-42e4-a644-eed17e8cbc54 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.847646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 529/1076] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:03.850450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.850613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:03.850912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.851094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.851292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:03.851588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:03.851873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:03.852577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:03.852891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:03.854439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:03.866863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 548/1077] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:03.871969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:03.873826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:03.875051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:03.905244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:03.965190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 530/1078] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:56:04.005969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052971b-d947-4135-8269-19bcb7818d71 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:04.043084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:04.043719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:04.044004 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:04.044282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] PATH_INFO: `/v3/users/54eeac0fdc2d4475bf2a27e9c3c6e109` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:04.045470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] RBAC: Authorizing `identity:get_user(user_id=54eeac0fdc2d4475bf2a27e9c3c6e109)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:04.046940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:04.052994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 549/1079] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:03 2022] GET /identity/v3/users/54eeac0fdc2d4475bf2a27e9c3c6e109 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:04.055367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:04.105014 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:04.171622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca99797-1410-49cb-9e26-f175e7eeceb5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:04.214748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:04.215519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:04.215873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:04.216213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:04.217835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] RBAC: Authorizing `identity:get_project(project_id=321d375fcb044885b3027e621f87aa85)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:04.220248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:04.227414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 531/1080] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:04 2022] GET /identity/v3/projects/321d375fcb044885b3027e621f87aa85 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:04.228650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:04.249497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:04.351902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:04.359963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0e193-aea2-4bdb-bcb1-9e440cdfe65f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:04.388789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3d76a-472c-4e9c-b883-78df16f83df9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:04.413053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:04.413752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:04.414033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:04.414308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85/users/54eeac0fdc2d4475bf2a27e9c3c6e109/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:04.414467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:04.416400 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] RBAC: Authorizing `identity:create_grant(project_id=321d375fcb044885b3027e621f87aa85, user_id=54eeac0fdc2d4475bf2a27e9c3c6e109, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:04.417893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:04.436489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:04.437193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:04.437545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:04.437753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:04.497931 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 550/1081] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:56:04 2022] PUT /identity/v3/projects/321d375fcb044885b3027e621f87aa85/users/54eeac0fdc2d4475bf2a27e9c3c6e109/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:56:04.534201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:04.540256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:04.652397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 532/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:04.657175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:04.774218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52e63b-6a0f-4f4e-bca6-1e533200a061 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:04.813582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:04.814467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:04.814904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:04.815358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:04.827221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:04.828892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c0b3d50c-8020-4694-93c1-cbc3d8d99e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:56:04.845258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:04.846357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:56:04.847861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:56:04.847861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:04.847861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:04.848570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 551/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:04.858272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:04.875342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:04.969983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbca773-b23e-48ff-890e-8cbfb5bbf389 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:05.008155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:05.008706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:05.008999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:05.009277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:05.009925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:05.010225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:05.011595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe34be-63e4-4980-991b-10f925dad93e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:05.025141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 533/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:05.828892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24184d-5623-4256-9be0-4f51e3bab3e6 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:05.829604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24184d-5623-4256-9be0-4f51e3bab3e6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:05.829604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24184d-5623-4256-9be0-4f51e3bab3e6 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:05.831305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 552/1085] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:56:05.837744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:05.838260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:05.838734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:05.859540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:05.860747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:05.936962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 534/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:06.216867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24184d-5623-4256-9be0-4f51e3bab3e6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:06.226537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:06.329902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24184d-5623-4256-9be0-4f51e3bab3e6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:06.368707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7cd41-3c74-48c9-9584-974aef634b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:06.369388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7cd41-3c74-48c9-9584-974aef634b62 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:06.369674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7cd41-3c74-48c9-9584-974aef634b62 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:06.369949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7cd41-3c74-48c9-9584-974aef634b62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:06.384398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7cd41-3c74-48c9-9584-974aef634b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-40a7cd41-3c74-48c9-9584-974aef634b62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:06.389425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:06.390429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:06.391562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 553/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 30 00:56:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:06.397558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:06.400724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:06.481281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2325a-6179-4bf1-861e-129e17a710a8 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:06.481487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2325a-6179-4bf1-861e-129e17a710a8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:06.481730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2325a-6179-4bf1-861e-129e17a710a8 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:06.483154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 554/1088] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:56:06.488901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:06.489208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:06.489484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:06.509370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:06.510793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:06.514099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5534d5-eba3-4567-8ea1-61dd8d814bfd None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:06.551560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:06.552167 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:06.552456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:06.552737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:06.553437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:06.553745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:06.555113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:06.563448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 535/1089] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:56:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:06.571578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:06.576919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:06.585325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 555/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:06.638409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:06.677942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa2dc-63a2-4878-a604-d38c7d5f5b26 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:06.715344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:06.716001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:06.716261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:06.716600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:06.728488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:06.729978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:56:06.745080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:06.746622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:56:06.747547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:56:06.747547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:06.747547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:06.747547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 536/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:06.752178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:06.865321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:06.872077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecc768-78b5-4d18-af5f-bf7c1851c103 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:06.909975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:06.910590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:06.910873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:06.911152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:06.911808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:06.912115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:06.913544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:06.929080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 556/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:06.935061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:06.980422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e7b83-76f5-4cda-9c29-27767e715357 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.000275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.001294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.017626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.018317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.018617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.018888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.029603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:07.035132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:07.039772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:07.040894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 537/1093] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:07.042676 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.054466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f097b-ec49-4d56-aa4c-2cde2ac71936 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.092530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.093201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.093485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.093768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.102672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.104247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:56:07.116668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:07.117957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:07.118905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 557/1094] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 30 00:56:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:07.123846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.151433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e986a6-44e6-487f-82ac-985f7f6793e5 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.190109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.190720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.191004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.191277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.191979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:07.192283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.193710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.203355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 538/1095] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:07.209773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.227467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b24be-119b-4486-a267-b1af260dcd56 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.243907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.254237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.262594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.263240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.263529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.263830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.264568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:07.264878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.266362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.285698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 558/1096] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:07.291601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.316907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fcd15-c957-4b1b-86b7-fa06a51a5543 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.355720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.356361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.356704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.357014 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] PATH_INFO: `/v3/users/54eeac0fdc2d4475bf2a27e9c3c6e109` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.358173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] RBAC: Authorizing `identity:get_user(user_id=54eeac0fdc2d4475bf2a27e9c3c6e109)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.359608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.361284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 539/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/users/54eeac0fdc2d4475bf2a27e9c3c6e109 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:07.367638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.404457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3278-6ef9-42d5-8e3b-8fa2e8301e6c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.441613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.441613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.441613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.442461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.472953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bfaf1-5125-4d7f-a798-0946f0bf2d61 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.482615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.488657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.511213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.511736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.512015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.512449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.515446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.517261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.597475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.598932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.637125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 559/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:56:07.638224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.715492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 540/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:56:07.721514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.731262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.736232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.763378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90dc2-9643-4994-87d8-77796231e2eb None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.800435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.801332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.801762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.802170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.813288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.814746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:56:07.832238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:07.833368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:56:07.834294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:56:07.834294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:56:07.834294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:07.834294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 560/1100] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:07.837841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2e96-51e6-4e27-a529-6fabe18c3a88 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.839267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.878234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.879440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.879725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.880009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.881452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] RBAC: Authorizing `identity:get_project(project_id=321d375fcb044885b3027e621f87aa85)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.882683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:07.884322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 541/1101] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/projects/321d375fcb044885b3027e621f87aa85 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:07.890979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:07.953995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c73257-8cb0-4bae-ba41-2c5176d4c148 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:07.979733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.985936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:07.991545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:07.992187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:07.992473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:07.992752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:07.993467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:07.995215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:07.995215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:08.009282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 561/1102] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:08.010510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c7467-b10e-4e5c-95e6-4c2ae834e38b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:08.026646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:08.046494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:08.047107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:08.047393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:08.047671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:08.048407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=321d375fcb044885b3027e621f87aa85, user.id=54eeac0fdc2d4475bf2a27e9c3c6e109) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:08.048716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:08.050746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:08.056712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 542/1103] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:07 2022] GET /identity/v3/role_assignments?user.id=54eeac0fdc2d4475bf2a27e9c3c6e109&scope.project.id=321d375fcb044885b3027e621f87aa85&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:08.138006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540647b2-3ea7-493d-8b07-8ba92719adc7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:08.176626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:08.177314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:08.177597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:08.177877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:08.185441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:08.186921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:56:08.201003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:08.201985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:56:08.203073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:08.205099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 562/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:08.207573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:08.317856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd606d-05b7-4f6b-a5a1-3bcbf58d4a64 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:08.366538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:08.367153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:08.367436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:08.367720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:08.368417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:08.368729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:08.370187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531cee4-22b7-4117-8264-b190c4222183 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:08.380166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:08.383621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 543/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:08.389816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:08.441627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:08.507410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8f24-b284-4e4d-86ae-366796d2c3dc None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:08.547155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:08.547769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:08.548055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:08.548334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:08.549129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] RBAC: Adding query filter params (role.id=c73c55366cc54d609b27a8475b843d42, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=e3083107d17b4596b7b858df7fc50147) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:08.549488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:08.551750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d2b2c-6655-4ff4-b947-f5add689dbd6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:08.567340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 563/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:08 2022] GET /identity/v3/role_assignments?user.id=e3083107d17b4596b7b858df7fc50147&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c73c55366cc54d609b27a8475b843d42 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:10.063426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f3f97-5a3e-4302-b10a-fed6270ff5e4 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:10.063961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f3f97-5a3e-4302-b10a-fed6270ff5e4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:10.063961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f3f97-5a3e-4302-b10a-fed6270ff5e4 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:10.065515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 544/1107] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:10.070832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:10.071261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:10.071374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:10.089477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:10.090683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:10.161804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 564/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:10.447877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f3f97-5a3e-4302-b10a-fed6270ff5e4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:10.554033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f3f97-5a3e-4302-b10a-fed6270ff5e4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:10.593565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42227d2c-75a2-4f96-b427-f10fec62c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:10.594209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227d2c-75a2-4f96-b427-f10fec62c484 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:10.594497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227d2c-75a2-4f96-b427-f10fec62c484 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:10.594786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42227d2c-75a2-4f96-b427-f10fec62c484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:10.597236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42227d2c-75a2-4f96-b427-f10fec62c484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:10.599406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42227d2c-75a2-4f96-b427-f10fec62c484 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:10.601034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 545/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:10.606878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:10.657540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:10.722363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4ef04-6ec2-42d3-9029-cc87a66d4974 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:10.758028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9a077-d562-4466-ae44-680f6512c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:10.758641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a077-d562-4466-ae44-680f6512c538 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:10.758930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a077-d562-4466-ae44-680f6512c538 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:10.759210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a077-d562-4466-ae44-680f6512c538 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:10.759880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9a077-d562-4466-ae44-680f6512c538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:10.761352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9a077-d562-4466-ae44-680f6512c538 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:10.896009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 565/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:56:10 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:12.881516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be714f9-6e86-46ce-89bc-72c83655a19e None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:12.882122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be714f9-6e86-46ce-89bc-72c83655a19e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:12.882122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be714f9-6e86-46ce-89bc-72c83655a19e None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:12.883310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 546/1111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:12.889003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:12.889837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:12.889837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:12.908981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:12.910296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:12.979652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 566/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:13.250888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be714f9-6e86-46ce-89bc-72c83655a19e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:13.337153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:13.371169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be714f9-6e86-46ce-89bc-72c83655a19e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:13.404771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:13.405430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:13.405715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:13.405990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] PATH_INFO: `/v3/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:13.407392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] RBAC: Authorizing `identity:get_role(role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:13.408795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:13.410182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 547/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:13 2022] GET /identity/v3/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:13.416203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:13.446046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:13.522489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465820d4-37e9-4f88-a6f6-092d4a357ffe None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:13.559540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:13.560448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:13.560860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:13.561363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] PATH_INFO: `/v3/users/155fe799d1bf415dbd6f9701ac292ad1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:13.580482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] RBAC: Authorizing `identity:get_user(user_id=155fe799d1bf415dbd6f9701ac292ad1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:13.582065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:13.583787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 567/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:13 2022] GET /identity/v3/users/155fe799d1bf415dbd6f9701ac292ad1 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:13.590035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:13.697230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f06a9-47ed-4ea5-9a17-bd9a9fe2d8a4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:13.731839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:13.732452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:13.732737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:13.733045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:13.736416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:13.804033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:13.805488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:13.909525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 548/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:13.919207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:14.005538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:14.023555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c72b4-236e-460c-9831-2f539a74ed36 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:14.058386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3840d78-73e9-40bf-936a-ec31d91cb934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:14.058937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840d78-73e9-40bf-936a-ec31d91cb934 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:14.059222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840d78-73e9-40bf-936a-ec31d91cb934 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:14.059502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840d78-73e9-40bf-936a-ec31d91cb934 None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:14.060642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3840d78-73e9-40bf-936a-ec31d91cb934 None admin] RBAC: Authorizing `identity:get_project(project_id=321d375fcb044885b3027e621f87aa85)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:14.062121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3840d78-73e9-40bf-936a-ec31d91cb934 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:14.064030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 568/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:13 2022] GET /identity/v3/projects/321d375fcb044885b3027e621f87aa85 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:14.072329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:14.108823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:14.179985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84e33-f26e-4336-99f5-259c4623452e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:14.214873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:14.215463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:14.215746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:14.216026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:14.216750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] RBAC: Adding query filter params (role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=321d375fcb044885b3027e621f87aa85, user.id=155fe799d1bf415dbd6f9701ac292ad1) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:14.217093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:14.218519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104753cd-3742-48ed-9517-6c1fa9ab8f6f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:14.224492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 549/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:14 2022] GET /identity/v3/role_assignments?user.id=155fe799d1bf415dbd6f9701ac292ad1&scope.project.id=321d375fcb044885b3027e621f87aa85&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:16.130483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25bfc-7ab4-4a13-bdfe-c2ed67622096 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:16.131024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25bfc-7ab4-4a13-bdfe-c2ed67622096 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:16.131024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25bfc-7ab4-4a13-bdfe-c2ed67622096 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:16.132349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 569/1118] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:16.137861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:16.138256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:16.138422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:16.164541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:16.165801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:16.235755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 550/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:16.508042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25bfc-7ab4-4a13-bdfe-c2ed67622096 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:16.617334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25bfc-7ab4-4a13-bdfe-c2ed67622096 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:16.651074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:16.651702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:16.651985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:16.652264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] PATH_INFO: `/v3/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:16.653853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] RBAC: Authorizing `identity:get_role(role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:16.655229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:16.656572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 570/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:16 2022] GET /identity/v3/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:16.663504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:16.698622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:16.767850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c01e6-facc-4a8d-a03a-b6efef22dc0e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:16.803067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:16.803743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:16.804030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:16.804310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] PATH_INFO: `/v3/users/155fe799d1bf415dbd6f9701ac292ad1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:16.805546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] RBAC: Authorizing `identity:get_user(user_id=155fe799d1bf415dbd6f9701ac292ad1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:16.806977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:16.808591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 551/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:16 2022] GET /identity/v3/users/155fe799d1bf415dbd6f9701ac292ad1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:16.814733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:16.836889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:16.920051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659dff-04b1-4db5-a0aa-9c2923eb1a94 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:16.957460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35d014-1af0-4f6c-8624-f281cdc0fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:16.958090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35d014-1af0-4f6c-8624-f281cdc0fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:16.958370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35d014-1af0-4f6c-8624-f281cdc0fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:16.958646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35d014-1af0-4f6c-8624-f281cdc0fbc1 None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:16.959802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35d014-1af0-4f6c-8624-f281cdc0fbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=321d375fcb044885b3027e621f87aa85)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:16.961271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35d014-1af0-4f6c-8624-f281cdc0fbc1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:16.962910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 571/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:16 2022] GET /identity/v3/projects/321d375fcb044885b3027e621f87aa85 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:16.969126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:17.070843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:17.074863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb0335-482d-4dd3-bc6e-0e5dbc03e5fa None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:17.109021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c730d-5e83-444f-b7b4-b52575c64137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:17.109688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c730d-5e83-444f-b7b4-b52575c64137 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:17.109973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c730d-5e83-444f-b7b4-b52575c64137 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:17.110305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c730d-5e83-444f-b7b4-b52575c64137 None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85/users/155fe799d1bf415dbd6f9701ac292ad1/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:17.113870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c730d-5e83-444f-b7b4-b52575c64137 None admin] RBAC: Authorizing `identity:create_grant(project_id=321d375fcb044885b3027e621f87aa85, user_id=155fe799d1bf415dbd6f9701ac292ad1, role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:17.115353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c730d-5e83-444f-b7b4-b52575c64137 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:17.203611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 552/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:56:16 2022] PUT /identity/v3/projects/321d375fcb044885b3027e621f87aa85/users/155fe799d1bf415dbd6f9701ac292ad1/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:56:19.136290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9162c-e2db-4f5f-844f-c6543439b031 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:19.136850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9162c-e2db-4f5f-844f-c6543439b031 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:19.136973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9162c-e2db-4f5f-844f-c6543439b031 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:19.138440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 572/1124] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:19.144224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:19.144645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:19.144780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:19.163291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:19.164478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:19.231747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 553/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:19.509894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9162c-e2db-4f5f-844f-c6543439b031 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:19.600497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:19.613163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9162c-e2db-4f5f-844f-c6543439b031 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:19.647999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:19.648635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:19.649272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:19.649272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] PATH_INFO: `/v3/roles/3e62adc9b1b144a4b4ee6357396e4ae0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:19.650635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] RBAC: Authorizing `identity:get_role(role_id=3e62adc9b1b144a4b4ee6357396e4ae0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:19.652506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:19.653950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 573/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:19 2022] GET /identity/v3/roles/3e62adc9b1b144a4b4ee6357396e4ae0 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:19.660386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:19.763521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:19.775535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2d5f2-8f23-4740-a8b2-828bdf69d8cd None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:19.810772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:19.811405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:19.811687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:19.811964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] PATH_INFO: `/v3/users/155fe799d1bf415dbd6f9701ac292ad1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:19.813391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] RBAC: Authorizing `identity:get_user(user_id=155fe799d1bf415dbd6f9701ac292ad1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:19.815444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:19.817225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 554/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:19 2022] GET /identity/v3/users/155fe799d1bf415dbd6f9701ac292ad1 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:19.822945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:19.925473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723f294-9de3-4f53-9568-10a19bd5e1fc None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:19.960387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:19.961122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:19.961364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:19.961647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:19.987786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:20.037762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:20.040116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:20.138244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 574/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:20.144825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:20.243191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7819b4-d1c4-4a2b-9912-bb84cdb894de None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:20.277772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96278ce-a877-425d-afc4-cb32cad0662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:20.278397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96278ce-a877-425d-afc4-cb32cad0662f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:20.278681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96278ce-a877-425d-afc4-cb32cad0662f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:20.278961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96278ce-a877-425d-afc4-cb32cad0662f None admin] PATH_INFO: `/v3/projects/321d375fcb044885b3027e621f87aa85` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:20.280142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96278ce-a877-425d-afc4-cb32cad0662f None admin] RBAC: Authorizing `identity:get_project(project_id=321d375fcb044885b3027e621f87aa85)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:20.281605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96278ce-a877-425d-afc4-cb32cad0662f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:20.283255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 555/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:20 2022] GET /identity/v3/projects/321d375fcb044885b3027e621f87aa85 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:20.289861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:20.346100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:20.390963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc581-a834-4324-9ef8-0670a4e36326 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:20.425332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:20.425938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:20.426219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:20.426494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:20.427217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] RBAC: Adding query filter params (role.id=3e62adc9b1b144a4b4ee6357396e4ae0, scope.project.id=321d375fcb044885b3027e621f87aa85, user.id=155fe799d1bf415dbd6f9701ac292ad1) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:20.427533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:20.428976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9460fb-cc68-4f0d-bfd2-d03bcbcb69f6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:20.434687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 575/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:20 2022] GET /identity/v3/role_assignments?user.id=155fe799d1bf415dbd6f9701ac292ad1&scope.project.id=321d375fcb044885b3027e621f87aa85&role.id=3e62adc9b1b144a4b4ee6357396e4ae0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:22.401520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e648e3-e7d7-425d-bc17-691ac9dbc508 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:22.402129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e648e3-e7d7-425d-bc17-691ac9dbc508 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:22.402129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e648e3-e7d7-425d-bc17-691ac9dbc508 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:22.403387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 556/1131] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:22.409067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:22.409559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:22.409641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:22.428658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:22.429914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:22.503636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 576/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:22.778693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e648e3-e7d7-425d-bc17-691ac9dbc508 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:22.803575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:22.879703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e648e3-e7d7-425d-bc17-691ac9dbc508 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:22.913972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b46d1-727b-4df7-878a-9fb20dc2c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:22.914597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b46d1-727b-4df7-878a-9fb20dc2c452 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:22.914877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b46d1-727b-4df7-878a-9fb20dc2c452 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:22.915151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b46d1-727b-4df7-878a-9fb20dc2c452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:22.916253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b46d1-727b-4df7-878a-9fb20dc2c452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:22.917707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b46d1-727b-4df7-878a-9fb20dc2c452 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:22.919282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 557/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:22.925713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:22.973792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:23.023655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e4889-6a6e-448f-a539-312983d4a174 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:23.056881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef0a11-ce04-4eab-a208-6188876f388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:23.057450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0a11-ce04-4eab-a208-6188876f388c None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:23.057734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0a11-ce04-4eab-a208-6188876f388c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:23.058008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef0a11-ce04-4eab-a208-6188876f388c None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:23.058668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef0a11-ce04-4eab-a208-6188876f388c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:23.060115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef0a11-ce04-4eab-a208-6188876f388c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:23.159543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 577/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:56:22 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:25.112826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72ba8-7efe-4ad3-b9c1-70d874b6d6fd None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:25.113423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72ba8-7efe-4ad3-b9c1-70d874b6d6fd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:25.113423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72ba8-7efe-4ad3-b9c1-70d874b6d6fd None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:25.115551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 558/1135] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:25.121262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:25.121733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:25.121837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:25.140753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:25.141976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:25.209769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 578/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:25.481382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b72ba8-7efe-4ad3-b9c1-70d874b6d6fd None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:25.578532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:25.588325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b72ba8-7efe-4ad3-b9c1-70d874b6d6fd None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:25.622845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913bf6b-95c5-4285-ac9a-99dc3a8e9048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:25.623473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913bf6b-95c5-4285-ac9a-99dc3a8e9048 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:25.623760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913bf6b-95c5-4285-ac9a-99dc3a8e9048 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:25.624094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913bf6b-95c5-4285-ac9a-99dc3a8e9048 None admin] PATH_INFO: `/v3/domains/default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:25.625297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913bf6b-95c5-4285-ac9a-99dc3a8e9048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:25.626810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913bf6b-95c5-4285-ac9a-99dc3a8e9048 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:25.628418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 559/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:25.634314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:25.664874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:25.738912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6db217-0663-48fb-8de0-e3d09d93f35c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:25.778053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09e9ba-da87-43f5-96f2-ba2243cd1879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:25.778662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e9ba-da87-43f5-96f2-ba2243cd1879 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:25.778947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e9ba-da87-43f5-96f2-ba2243cd1879 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:25.779224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09e9ba-da87-43f5-96f2-ba2243cd1879 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:25.779871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09e9ba-da87-43f5-96f2-ba2243cd1879 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:25.781326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09e9ba-da87-43f5-96f2-ba2243cd1879 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:25.918224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 579/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:56:25 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:27.919594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1654cc1-8f72-422f-9578-fa7dba3d2e7c None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:27.920118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1654cc1-8f72-422f-9578-fa7dba3d2e7c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:27.920118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1654cc1-8f72-422f-9578-fa7dba3d2e7c None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:27.921489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 560/1139] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:27.927399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:27.927825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:27.927984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:27.946926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:27.948108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:28.013363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 580/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:28.280257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1654cc1-8f72-422f-9578-fa7dba3d2e7c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:28.383156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1654cc1-8f72-422f-9578-fa7dba3d2e7c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:28.417883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:28.418514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.423279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.423279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:28.434709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:28.440663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:28.441967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:28.442988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 561/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:28.448250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:28.466326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:28.547664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb496-a9ef-4fcb-a0de-15e8ea271089 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:28.584926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:28.585550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.585834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.586102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:28.586763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:28.587064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:28.588434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:28.597130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 581/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:28.602990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:28.626256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:28.713898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ad05-1e8d-4820-815a-b42a6a1d0167 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:28.766587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:28.767723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.768006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.768287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] PATH_INFO: `/v3/users/77554a85de2d4c79bf299bed595c5d96` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:28.781765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] RBAC: Authorizing `identity:get_user(user_id=77554a85de2d4c79bf299bed595c5d96)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:28.783765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:28.785466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 562/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:28 2022] GET /identity/v3/users/77554a85de2d4c79bf299bed595c5d96 => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:28.791467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:28.874024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:28.896024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1ca0-609e-45b9-ab0e-28db20903f68 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:28.932043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:28.932888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:28.933212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:28.933495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:29.000786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:29.002853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:29.087435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:29.108554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 582/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:29.114677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:29.193455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:29.215393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4357d0-e17a-4dc5-a5f3-f0e17da9d4a6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:29.251131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9ff4a-c7bc-4670-a1bd-0a5bb36d174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:29.252575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ff4a-c7bc-4670-a1bd-0a5bb36d174a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:29.252859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ff4a-c7bc-4670-a1bd-0a5bb36d174a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:29.253177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ff4a-c7bc-4670-a1bd-0a5bb36d174a None admin] PATH_INFO: `/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:29.254325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9ff4a-c7bc-4670-a1bd-0a5bb36d174a None admin] RBAC: Authorizing `identity:get_project(project_id=0f6c7ccd816b41bfa43f37aa6c66a9c0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:29.255774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9ff4a-c7bc-4670-a1bd-0a5bb36d174a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:29.257498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 563/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:29 2022] GET /identity/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:29.263940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:29.367562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40115aa-1fc0-4c9d-a043-b616c431174d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:29.410831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:29.411441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:29.411722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:29.411999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:29.412739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=0f6c7ccd816b41bfa43f37aa6c66a9c0, user.id=77554a85de2d4c79bf299bed595c5d96) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:29.413085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:29.416429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1319790-0755-4b81-96c0-6ac64909c011 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:29.422581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 583/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:29 2022] GET /identity/v3/role_assignments?user.id=77554a85de2d4c79bf299bed595c5d96&scope.project.id=0f6c7ccd816b41bfa43f37aa6c66a9c0&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:31.339076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a9973-8753-47e4-94f4-622980b5d7c0 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:31.339649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a9973-8753-47e4-94f4-622980b5d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:31.339649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a9973-8753-47e4-94f4-622980b5d7c0 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:31.340957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 564/1147] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:31.346413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:31.346868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:31.346978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:31.365830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:31.367009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:31.409346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:31.435896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 584/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:31.711511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a9973-8753-47e4-94f4-622980b5d7c0 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:31.816711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a9973-8753-47e4-94f4-622980b5d7c0 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:31.851050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:31.851708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:31.851992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:31.852269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:31.862785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:31.867521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:31.868631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:31.869879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 565/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:31.874651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:31.980251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420028a8-81d9-4bcb-a893-0d9fcdb8d5a0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:32.016622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:32.017447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:32.017732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:32.018015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:32.018689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:32.018996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:32.020409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:32.028978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 585/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:32.035890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:32.048530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:32.142982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086b94-5a86-46ef-b55b-066a342e2bfc None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:32.180675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:32.181335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:32.181618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:32.181895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] PATH_INFO: `/v3/users/77554a85de2d4c79bf299bed595c5d96` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:32.183024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] RBAC: Authorizing `identity:get_user(user_id=77554a85de2d4c79bf299bed595c5d96)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:32.184462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:32.186087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 566/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:32 2022] GET /identity/v3/users/77554a85de2d4c79bf299bed595c5d96 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:32.194306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:32.238029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:32.302516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793c703-635d-4558-8653-35a3386f27a9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:32.337023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10f03f-823b-4d83-bede-16edb79a2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:32.337592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10f03f-823b-4d83-bede-16edb79a2d11 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:32.337879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10f03f-823b-4d83-bede-16edb79a2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:32.338234 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10f03f-823b-4d83-bede-16edb79a2d11 None admin] PATH_INFO: `/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:32.339312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10f03f-823b-4d83-bede-16edb79a2d11 None admin] RBAC: Authorizing `identity:get_project(project_id=0f6c7ccd816b41bfa43f37aa6c66a9c0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:32.340755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10f03f-823b-4d83-bede-16edb79a2d11 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:32.342480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 586/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:32 2022] GET /identity/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:32.349075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:32.423732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:32.449936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3eaaa-a2fb-44be-8184-e0f4b0236c00 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:32.485532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d5ff4-1931-4bd9-b6ff-d6510c320378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:32.486222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d5ff4-1931-4bd9-b6ff-d6510c320378 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:32.486652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d5ff4-1931-4bd9-b6ff-d6510c320378 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:32.486932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d5ff4-1931-4bd9-b6ff-d6510c320378 None admin] PATH_INFO: `/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0/users/77554a85de2d4c79bf299bed595c5d96/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:32.488874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d5ff4-1931-4bd9-b6ff-d6510c320378 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f6c7ccd816b41bfa43f37aa6c66a9c0, user_id=77554a85de2d4c79bf299bed595c5d96, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:32.490280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d5ff4-1931-4bd9-b6ff-d6510c320378 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:32.632068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 567/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:56:32 2022] PUT /identity/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0/users/77554a85de2d4c79bf299bed595c5d96/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:56:34.514532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acb57-2a7d-4464-8c61-f5cfa89c9bda None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:34.515079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acb57-2a7d-4464-8c61-f5cfa89c9bda None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:34.515079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acb57-2a7d-4464-8c61-f5cfa89c9bda None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:34.516410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 587/1154] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:34.521747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:34.522202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:34.522295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:34.540617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:34.541827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:34.607589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 568/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:34.901817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acb57-2a7d-4464-8c61-f5cfa89c9bda None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.010017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acb57-2a7d-4464-8c61-f5cfa89c9bda None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:35.012443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:35.044697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:35.045370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:35.045653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:35.045933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:35.056477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:35.061848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:35.066369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:35.067419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 588/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:35.069672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.136320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:35.178916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2d91f-edc1-441c-9700-c40834af09bf None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:35.215620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:35.216256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:35.216542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:35.216821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:35.217517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:35.217824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:35.219185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:35.227974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 569/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:35.233824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.345210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ce0f-b006-4e9c-a6d6-8c92c00b68eb None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:35.380330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:35.380996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:35.381301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:35.381568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] PATH_INFO: `/v3/users/77554a85de2d4c79bf299bed595c5d96` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:35.382724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=77554a85de2d4c79bf299bed595c5d96)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:35.384183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:35.385829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 589/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:35 2022] GET /identity/v3/users/77554a85de2d4c79bf299bed595c5d96 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:35.392854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.499181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccec08-2489-4703-b3b3-fa05977c22be None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:35.526567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:35.536027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:35.536638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:35.539085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:35.539085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:35.606591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:35.608046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:35.711371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 570/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:35.717525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.751503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:35.834122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd767bbc-046e-46fd-8662-2ffcdede0ff6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:35.871806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7828e-26b8-45d0-883a-54691cbcf5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:35.872440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7828e-26b8-45d0-883a-54691cbcf5bb None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:35.872723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7828e-26b8-45d0-883a-54691cbcf5bb None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:35.873032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7828e-26b8-45d0-883a-54691cbcf5bb None admin] PATH_INFO: `/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:35.874188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7828e-26b8-45d0-883a-54691cbcf5bb None admin] RBAC: Authorizing `identity:get_project(project_id=0f6c7ccd816b41bfa43f37aa6c66a9c0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:35.875663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7828e-26b8-45d0-883a-54691cbcf5bb None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:35.878563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 590/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:35 2022] GET /identity/v3/projects/0f6c7ccd816b41bfa43f37aa6c66a9c0 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:35.885421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:35.914257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:35.990712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082c722-6e59-47f8-88a7-7bad45a8fe7e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:36.023428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:36.024123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:36.024123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:36.024679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:36.025321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=0f6c7ccd816b41bfa43f37aa6c66a9c0, user.id=77554a85de2d4c79bf299bed595c5d96) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:36.025637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:36.027050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14da8d-c1b5-4af5-b0cb-26c4fb349d55 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:36.033256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 571/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:35 2022] GET /identity/v3/role_assignments?user.id=77554a85de2d4c79bf299bed595c5d96&scope.project.id=0f6c7ccd816b41bfa43f37aa6c66a9c0&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:38.008473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a5c1-f9cf-420d-9ce2-51c93e659f26 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:38.009045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a5c1-f9cf-420d-9ce2-51c93e659f26 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:38.009135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044a5c1-f9cf-420d-9ce2-51c93e659f26 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:38.010436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 591/1162] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:38.016179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:38.016655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:38.016896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:38.036053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:38.037311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:38.108868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 572/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:38.380052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044a5c1-f9cf-420d-9ce2-51c93e659f26 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:38.494425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:38.498556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044a5c1-f9cf-420d-9ce2-51c93e659f26 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:38.536546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:38.537196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:38.537485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:38.537769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:38.610636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:38.612149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:38.718091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:38.722019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 592/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:38.728817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:38.749930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:38.831122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc0d1-3024-4dbf-b897-4a50583a1554 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:38.871444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:38.872102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:38.872364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:38.872644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:38.880115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:38.881707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-fa73cbff-01e4-46e3-8252-19004f224d35 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:38.894362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:38.895468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:56:38.896412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:38.900798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 573/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:56:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:38.901831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:39.011164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ca1dc-0c6a-4c22-ae9d-923884563b79 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:39.048694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:39.049324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:39.049598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:39.049866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:39.050684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:39.050987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:39.052459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a1c7-dec4-496d-b3d2-5d42229d3cc5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:39.065000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 593/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 30 00:56:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:40.988130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9ff01-ff93-482c-aa0f-957ed0640c47 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:40.988675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9ff01-ff93-482c-aa0f-957ed0640c47 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:40.988675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9ff01-ff93-482c-aa0f-957ed0640c47 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:40.989981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 574/1167] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:40.995306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95478-f5d5-44ef-b24e-59a0a7fbde3a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:40.995754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95478-f5d5-44ef-b24e-59a0a7fbde3a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:40.995852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95478-f5d5-44ef-b24e-59a0a7fbde3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:41.018095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a4f95478-f5d5-44ef-b24e-59a0a7fbde3a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:41.019340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a4f95478-f5d5-44ef-b24e-59a0a7fbde3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:41.082424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:41.090506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 594/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:41.382393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9ff01-ff93-482c-aa0f-957ed0640c47 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:41.468908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:41.489227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9ff01-ff93-482c-aa0f-957ed0640c47 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:41.524073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a40db-b953-4635-b4b4-a29a84b83cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:41.524688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a40db-b953-4635-b4b4-a29a84b83cb1 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:41.524997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a40db-b953-4635-b4b4-a29a84b83cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:41.525278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a40db-b953-4635-b4b4-a29a84b83cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:41.525961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a40db-b953-4635-b4b4-a29a84b83cb1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:41.527375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a40db-b953-4635-b4b4-a29a84b83cb1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:41.621732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 575/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Tue Aug 30 00:56:41 2022] POST /identity/v3/domains => generated 267 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:43.608089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07637b56-8f6e-4fd2-849e-365cf48cb24a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:43.608645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07637b56-8f6e-4fd2-849e-365cf48cb24a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:43.608645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07637b56-8f6e-4fd2-849e-365cf48cb24a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:43.610047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 595/1170] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:43.615285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:43.615716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:43.615817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:43.634345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:43.635541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:43.706538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 576/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:43.982666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07637b56-8f6e-4fd2-849e-365cf48cb24a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:44.101362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07637b56-8f6e-4fd2-849e-365cf48cb24a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:44.136890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e7204-1945-4b07-901f-3e9ad9372672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:44.137553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7204-1945-4b07-901f-3e9ad9372672 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:44.137836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7204-1945-4b07-901f-3e9ad9372672 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:44.138111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7204-1945-4b07-901f-3e9ad9372672 None admin] PATH_INFO: `/v3/domains/ea21d73e75824ab291b0cc4a138710a0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:44.150104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e7204-1945-4b07-901f-3e9ad9372672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea21d73e75824ab291b0cc4a138710a0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:44.151571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e7204-1945-4b07-901f-3e9ad9372672 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:44.153278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 596/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 30 00:56:43 2022] GET /identity/v3/domains/ea21d73e75824ab291b0cc4a138710a0 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:44.159393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:44.238015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:44.272314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4202-d1cc-485a-9e69-f9cdb54c6572 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:44.307397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf8b5b-64a9-48be-8f12-aa545fcfcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:44.308005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8b5b-64a9-48be-8f12-aa545fcfcd3c None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:44.308290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8b5b-64a9-48be-8f12-aa545fcfcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:44.308567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8b5b-64a9-48be-8f12-aa545fcfcd3c None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:44.309261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8b5b-64a9-48be-8f12-aa545fcfcd3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:44.310705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8b5b-64a9-48be-8f12-aa545fcfcd3c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:44.444400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 577/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:56:44 2022] POST /identity/v3/projects => generated 361 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:46.414735 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95425b40-b44b-4123-a748-0a7e702a280e None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:46.415299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95425b40-b44b-4123-a748-0a7e702a280e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:46.415299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95425b40-b44b-4123-a748-0a7e702a280e None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:46.416635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 597/1174] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:46.421958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:46.422366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:46.422511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:46.441534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:46.442710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:46.515172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 578/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:46.796495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95425b40-b44b-4123-a748-0a7e702a280e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:46.856045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:46.905122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95425b40-b44b-4123-a748-0a7e702a280e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:46.941589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8aed3-10fc-49bf-9956-f4c068226047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:46.942213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8aed3-10fc-49bf-9956-f4c068226047 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:46.942493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8aed3-10fc-49bf-9956-f4c068226047 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:46.942779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8aed3-10fc-49bf-9956-f4c068226047 None admin] PATH_INFO: `/v3/domains/ea21d73e75824ab291b0cc4a138710a0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:46.944013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8aed3-10fc-49bf-9956-f4c068226047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea21d73e75824ab291b0cc4a138710a0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:46.945706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8aed3-10fc-49bf-9956-f4c068226047 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:46.947300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 598/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 30 00:56:46 2022] GET /identity/v3/domains/ea21d73e75824ab291b0cc4a138710a0 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:46.953302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:47.006598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:47.054534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e666cc-42ec-4d32-bf84-147d0039bf1b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:47.095729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2619cf-35ae-4d0a-bd8b-13d749dbb5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:47.096330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2619cf-35ae-4d0a-bd8b-13d749dbb5ec None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:47.096609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2619cf-35ae-4d0a-bd8b-13d749dbb5ec None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:47.096882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2619cf-35ae-4d0a-bd8b-13d749dbb5ec None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:47.097559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2619cf-35ae-4d0a-bd8b-13d749dbb5ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:47.098972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2619cf-35ae-4d0a-bd8b-13d749dbb5ec None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:47.219319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 579/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:56:46 2022] POST /identity/v3/users => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:56:49.220120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9acb-202d-4d1a-83d4-5dd4cac71167 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:49.220789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9acb-202d-4d1a-83d4-5dd4cac71167 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:49.220789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9acb-202d-4d1a-83d4-5dd4cac71167 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:49.222084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 599/1178] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:56:49.227654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:49.228250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:49.228250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:49.253268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:49.254470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:49.327745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 580/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:56:49.596973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9acb-202d-4d1a-83d4-5dd4cac71167 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:49.707038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9acb-202d-4d1a-83d4-5dd4cac71167 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:49.730497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:49.742925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:49.745818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:49.745818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:49.745818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:49.755563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:49.760991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:49.762231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:49.763128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 600/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:49.770736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:49.811381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:49.890530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cf25-d1b9-4e4b-a33f-43ef30c8ca27 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:49.928527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:49.929214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:49.929496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:49.929778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:49.930491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:49.930794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:49.932186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:49.942318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 581/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:49.948499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:50.073588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba71935-2d1e-4456-adcb-3875840b74da None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:50.109126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:50.109771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:50.110808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:50.111224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] PATH_INFO: `/v3/users/8b3fcd030c9942689fcd65c69fd6e0d0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:50.127755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] RBAC: Authorizing `identity:get_user(user_id=8b3fcd030c9942689fcd65c69fd6e0d0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:50.129232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:50.131099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 601/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:49 2022] GET /identity/v3/users/8b3fcd030c9942689fcd65c69fd6e0d0 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:50.137168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:50.248010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:50.250986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27ed3-b973-46d8-bd41-89a7273648ac None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:50.291001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:50.291708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:50.292021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:50.292335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:50.382399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:50.385083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:50.525827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:50.529440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 582/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:56:50.536285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:50.584716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:50.657814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121d2a4-4bf3-40a9-8861-18ee460c5517 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:50.697866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d82f98-aa97-46b6-bb34-9277a746cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:50.698507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d82f98-aa97-46b6-bb34-9277a746cfbf None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:50.698788 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d82f98-aa97-46b6-bb34-9277a746cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:50.699070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d82f98-aa97-46b6-bb34-9277a746cfbf None admin] PATH_INFO: `/v3/projects/f415b368bfc948c68c44fc438c98d3d5` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:50.700280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d82f98-aa97-46b6-bb34-9277a746cfbf None admin] RBAC: Authorizing `identity:get_project(project_id=f415b368bfc948c68c44fc438c98d3d5)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:50.701762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d82f98-aa97-46b6-bb34-9277a746cfbf None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:50.703427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 602/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:50 2022] GET /identity/v3/projects/f415b368bfc948c68c44fc438c98d3d5 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:50.712344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:50.834101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398aa2-a30b-481c-934d-94b10e9f8b4c None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:50.876351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:50.876988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:50.877274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:50.877548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:50.878283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=f415b368bfc948c68c44fc438c98d3d5, user.id=8b3fcd030c9942689fcd65c69fd6e0d0) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:50.878591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:50.880028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71da6be-ce77-4504-afe1-b901483f96f4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:50.885850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 583/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:50 2022] GET /identity/v3/role_assignments?user.id=8b3fcd030c9942689fcd65c69fd6e0d0&scope.project.id=f415b368bfc948c68c44fc438c98d3d5&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:53.014886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5179c-dbbb-4206-ad05-cf2f2f3b3a35 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:53.015454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5179c-dbbb-4206-ad05-cf2f2f3b3a35 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:53.015454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5179c-dbbb-4206-ad05-cf2f2f3b3a35 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:53.017585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 603/1186] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:53.025606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:53.026188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:53.026188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:53.045506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:53.046705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:53.120504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:53.129832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 584/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:56:53.404882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5179c-dbbb-4206-ad05-cf2f2f3b3a35 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:53.523335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5179c-dbbb-4206-ad05-cf2f2f3b3a35 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:53.533536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:53.558832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:53.559458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:53.559742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:53.560021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:53.571768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:53.576535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:53.577727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:53.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:56:53.581103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 604/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:56:53.584407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:53.693659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2161c-af03-489a-b516-a50d89db24d5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:53.733558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:53.734164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:53.734443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:53.734738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:53.735938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:53.736235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:53.737657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:53.746060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 585/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:53.752125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:53.857721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005bbc9-ba2b-41ff-a676-586479936a55 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:53.893344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:53.894125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:53.894279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:53.894519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] PATH_INFO: `/v3/users/8b3fcd030c9942689fcd65c69fd6e0d0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:53.895671 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] RBAC: Authorizing `identity:get_user(user_id=8b3fcd030c9942689fcd65c69fd6e0d0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:53.897186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:53.898746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 605/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:53 2022] GET /identity/v3/users/8b3fcd030c9942689fcd65c69fd6e0d0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:53.905063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:53.973363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:54.016635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89152-3857-4125-bb5e-a4130029e8e0 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:54.052587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30fcd1-d8c6-4f2b-aa71-97756f5a36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:54.053269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30fcd1-d8c6-4f2b-aa71-97756f5a36aa None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:54.053525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30fcd1-d8c6-4f2b-aa71-97756f5a36aa None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:54.053805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30fcd1-d8c6-4f2b-aa71-97756f5a36aa None admin] PATH_INFO: `/v3/projects/f415b368bfc948c68c44fc438c98d3d5` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:54.054948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30fcd1-d8c6-4f2b-aa71-97756f5a36aa None admin] RBAC: Authorizing `identity:get_project(project_id=f415b368bfc948c68c44fc438c98d3d5)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:54.056376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30fcd1-d8c6-4f2b-aa71-97756f5a36aa None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:54.058042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 586/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:53 2022] GET /identity/v3/projects/f415b368bfc948c68c44fc438c98d3d5 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:54.064492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:54.102921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:54.169848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abda4c-f53d-430c-aeb5-e9db809759cd None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:54.204026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7aa34-3bd8-41c6-a099-bc7862f27fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:54.204693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7aa34-3bd8-41c6-a099-bc7862f27fbc None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:54.205005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7aa34-3bd8-41c6-a099-bc7862f27fbc None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:54.205290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7aa34-3bd8-41c6-a099-bc7862f27fbc None admin] PATH_INFO: `/v3/projects/f415b368bfc948c68c44fc438c98d3d5/users/8b3fcd030c9942689fcd65c69fd6e0d0/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:54.207519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7aa34-3bd8-41c6-a099-bc7862f27fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=f415b368bfc948c68c44fc438c98d3d5, user_id=8b3fcd030c9942689fcd65c69fd6e0d0, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:54.208979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7aa34-3bd8-41c6-a099-bc7862f27fbc None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:54.276031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 606/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:56:54 2022] PUT /identity/v3/projects/f415b368bfc948c68c44fc438c98d3d5/users/8b3fcd030c9942689fcd65c69fd6e0d0/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:56:56.220622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f240-c851-46d6-a30a-d762720eaac5 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:56.221230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f240-c851-46d6-a30a-d762720eaac5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:56.221333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f240-c851-46d6-a30a-d762720eaac5 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:56.222698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 587/1193] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:56:56.229384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:56.229917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:56.230134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:56.253384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:56:56.254639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:56:56.341871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 607/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:56:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:56:56.642258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f240-c851-46d6-a30a-d762720eaac5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:56.760128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f240-c851-46d6-a30a-d762720eaac5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:56.789558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:56.796846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:56.798221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:56.801447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:56.801447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:56.809711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:56:56.816429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:56:56.817961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:56:56.819145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 588/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:56:56.824477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:56.851915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:56.928730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a572-b1c0-44cd-850d-91785d48cf6d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:56.972252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:56.972858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:56.973171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:56.973443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:56.974110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:56.974410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:56.975795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:56.984370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 608/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:56:56.991015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:57.127647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4ab24-145a-499d-9323-df9d3698cb6f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:57.166660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:57.167319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:57.167649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:57.167886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] PATH_INFO: `/v3/users/8b3fcd030c9942689fcd65c69fd6e0d0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:57.169059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] RBAC: Authorizing `identity:get_user(user_id=8b3fcd030c9942689fcd65c69fd6e0d0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:57.170507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:57.172131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 589/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 30 00:56:56 2022] GET /identity/v3/users/8b3fcd030c9942689fcd65c69fd6e0d0 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:57.178434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:57.276076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:57.288650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9e563-2076-491f-be90-5674cc619103 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:57.324006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:57.324622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:57.324909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:57.325221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:57.395814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:57.397225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:57.486079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:57.498594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 609/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:56:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:56:57.504746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:57.559671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:57.609113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dea38-3f17-49f0-9793-59dba5eecc6e None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:57.642827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b79d4-7d71-46e5-a929-d35cc2489558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:57.643454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b79d4-7d71-46e5-a929-d35cc2489558 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:57.643734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b79d4-7d71-46e5-a929-d35cc2489558 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:57.644006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b79d4-7d71-46e5-a929-d35cc2489558 None admin] PATH_INFO: `/v3/projects/f415b368bfc948c68c44fc438c98d3d5` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:57.645139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b79d4-7d71-46e5-a929-d35cc2489558 None admin] RBAC: Authorizing `identity:get_project(project_id=f415b368bfc948c68c44fc438c98d3d5)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:57.646650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b79d4-7d71-46e5-a929-d35cc2489558 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:57.648207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 590/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 30 00:56:57 2022] GET /identity/v3/projects/f415b368bfc948c68c44fc438c98d3d5 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:56:57.654495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:56:57.762948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78b808-93e0-4749-90f0-28cdff052da5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:56:57.798131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:56:57.798737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:56:57.799023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:56:57.799303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:56:57.800033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=f415b368bfc948c68c44fc438c98d3d5, user.id=8b3fcd030c9942689fcd65c69fd6e0d0) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:56:57.800406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:56:57.801924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62045-15c6-4af9-8784-007d8a63833d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:56:57.808265 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 610/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:56:57 2022] GET /identity/v3/role_assignments?user.id=8b3fcd030c9942689fcd65c69fd6e0d0&scope.project.id=f415b368bfc948c68c44fc438c98d3d5&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:57:07.638446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=40 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:07.805239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=74 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:10.317980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a5793-2cc2-4435-92dd-4fa67bc14769 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:10.318579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a5793-2cc2-4435-92dd-4fa67bc14769 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:10.318579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a5793-2cc2-4435-92dd-4fa67bc14769 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:10.319876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 591/1201] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:10.324989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:10.328899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:10.328899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:10.344200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:10.345565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:10.413089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 611/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:10.689196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a5793-2cc2-4435-92dd-4fa67bc14769 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:10.792187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a5793-2cc2-4435-92dd-4fa67bc14769 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:10.827949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:10.828573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:10.828856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:10.829163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:10.839212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:10.840650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:10.855268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:10.856507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:10.858486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:10.858486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:10.858486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:10.858486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 592/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:10.862882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:10.961266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab539-cf4d-4e01-a811-9ae7753d4061 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:10.991155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:10.996895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:10.997531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:10.998123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:10.998416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:10.999057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:10.999361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:11.000722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2a00-23b3-44cb-83d3-88584b7ef14a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:11.011512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 612/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:11.017983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:11.072148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:11.120333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1aff-91dc-4edc-a903-95af1276fe39 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:11.152833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b1df4-41f4-4b02-bdbc-d632a56d2c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:11.153466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b1df4-41f4-4b02-bdbc-d632a56d2c86 None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:11.153752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b1df4-41f4-4b02-bdbc-d632a56d2c86 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:11.154564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b1df4-41f4-4b02-bdbc-d632a56d2c86 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:11.155353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b1df4-41f4-4b02-bdbc-d632a56d2c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:11.156843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b1df4-41f4-4b02-bdbc-d632a56d2c86 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:11.226886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 593/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 30 00:58:11 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:13.205296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da10c2-e425-463a-a407-92d8c51238c7 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:13.205848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da10c2-e425-463a-a407-92d8c51238c7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:13.205951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da10c2-e425-463a-a407-92d8c51238c7 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:13.207231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 613/1206] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:13.212366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:13.212784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:13.212925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:13.231149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:13.232877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:13.299439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 594/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:13.571703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da10c2-e425-463a-a407-92d8c51238c7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:13.681341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da10c2-e425-463a-a407-92d8c51238c7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:13.715423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:13.716050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:13.716329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:13.717189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:13.727582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:13.733133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:13.734257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:13.735538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 614/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:58:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:13.740363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:13.781968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:13.846028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f58c5-25da-4520-a02b-4514f07e4b3d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:13.880596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:13.881240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:13.881531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:13.881807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:13.882472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:13.882778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:13.884146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:13.893017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 595/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:58:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:13.899052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:13.959676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:14.009582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14de8e-69f3-4525-a75b-b143d76000b6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:14.042080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:14.042629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:14.042912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:14.043188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:14.054087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:14.055535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:14.070274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:14.071468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:14.072359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:14.072359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:14.072359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:14.072359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 615/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:14.077538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:14.177420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:14.180239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135eb7-35bc-4547-904a-6c51718d7041 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:14.214001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:14.214642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:14.214836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:14.215107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:14.215739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:14.216099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:14.217764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:14.229895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 596/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:14.236652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:14.342122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e5a06-614f-41ab-8269-9a634c20202e None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:14.343852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:14.375821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:14.376443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:14.376731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:14.377037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:14.384241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:14.385722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:58:14.396655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:14.400738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:14.401934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 616/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:14.403794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:14.507319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b937dd4-a7bc-4ef9-a8c4-757505fd41c6 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:14.541301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:14.541911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:14.544564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:14.544564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:14.544564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:14.544564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:14.545692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:14.563129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 597/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 30 00:58:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:14.568831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:14.670431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969617fd-650e-4f11-a79d-92328ba907b3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:14.704385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:14.705015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:14.707044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:14.707326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:14.736921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:14.774328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:14.775793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:14.876139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 617/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:58:14.882022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:14.901779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:14.985078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325ee3-8996-49a4-a132-c2c02ff0ce6a None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:15.019435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:15.020065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:15.020347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:15.020625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:15.030910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:15.032362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:15.047764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:15.048962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:15.050169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:15.050169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:15.050169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:15.050169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 598/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:15.054548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:15.116447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:15.154681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d3e9c-dd37-4f38-9a31-c2690e702608 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:15.189407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:15.190013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:15.190300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:15.190580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:15.191257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:15.191565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:15.192966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:15.204485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 618/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:15.210252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:15.280630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:15.311541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc824b-ad18-4166-ab47-ff7bf2131577 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:15.345182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:15.345861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:15.346148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:15.346429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:15.353455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:15.354903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:58:15.367174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:15.368273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:15.369324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 599/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:15.375606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:15.478942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704e4b-dbe0-4ed9-a8c1-42a73a3720b9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:15.501990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:15.515584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:15.516254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:15.516546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:15.516827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:15.517561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:15.517872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:15.519317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b18fef-31e6-42fb-9357-df00ccc1a44b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:15.532857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 619/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:15.539104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:15.639881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4ac8-2f4a-4756-b99d-6b7bcde87f22 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:15.670355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:15.676068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:15.676675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:15.676976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:15.677258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:15.677978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7eb699757f93461d8a1c29611d1204e8) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:15.678288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:15.679704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d586c8-2aa3-46d5-a6c6-7ecad44a6075 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:15.684892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 600/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:15 2022] GET /identity/v3/role_assignments?user.id=7eb699757f93461d8a1c29611d1204e8&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:17.599003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710923-30a0-4d6e-9561-2d6c03e7c058 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:17.599644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710923-30a0-4d6e-9561-2d6c03e7c058 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:17.599644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710923-30a0-4d6e-9561-2d6c03e7c058 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:17.600953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 620/1220] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:17.606423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:17.606841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:17.607857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:17.627363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:17.628562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:17.702173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 601/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:17.975547 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710923-30a0-4d6e-9561-2d6c03e7c058 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:18.081539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710923-30a0-4d6e-9561-2d6c03e7c058 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:18.114745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:18.115373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:18.115660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:18.115941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:18.127186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:18.132017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:18.133166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:18.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 621/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:18.139742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:18.237096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf550-c7e5-4674-8b4e-163ceb2548b0 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:18.260041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:18.271214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:18.271815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:18.272095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:18.272371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:18.273055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] RBAC: Adding query filter params (name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:18.273357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:18.274877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:18.283038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 602/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:18.288743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:18.334518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:18.391200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85e3a-740b-4551-8ed0-7bc65f858dc7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:18.427932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:18.428562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:18.428848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:18.429155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:18.440087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:18.441626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:18.459869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:18.465111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:18.466274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:18.466274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:18.466274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:18.466274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 622/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:18.467071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:18.572986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caadf8b-2bc0-4867-a988-0d0561ea14da None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:18.609111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:18.609751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:18.609988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:18.610264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:18.610898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:18.611203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:18.612557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:18.624746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 603/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:18.631291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:18.732240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:18.739484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9191be-9e4d-405c-aa34-65a873ca2742 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:18.774003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:18.774881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:18.775001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:18.775216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:18.783921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:18.785405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:58:18.797015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:18.798149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:18.799131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 623/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:18.804549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:18.853189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:18.908163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f0b3-215f-4a6e-bf47-cea38ea8af06 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:18.944382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:18.945022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:18.945307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:18.945642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:18.946363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:18.946673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:18.948087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:18.967270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 604/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 30 00:58:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:18.973299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:19.072863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470044-d089-4fff-b231-36d1422673b4 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:19.108601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:19.109266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:19.109555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:19.109843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:19.120151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:19.121661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:19.136446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:19.142691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:19.145111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:19.145111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:19.145111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:19.145111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 624/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:19.145644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:19.247475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38125b76-59c2-442b-aba5-86d75fc7ec1f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:19.250456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:19.284516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:19.285160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:19.285448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:19.285729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:19.286376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:19.286687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:19.288060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:19.300022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 605/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:19.305951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:19.316353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:19.408644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2807a0-48ac-4ab0-874f-6b69847f92e3 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:19.442977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:19.443598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:19.443880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:19.444153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:19.450557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:19.452058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:58:19.465128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:19.469196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:19.470324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 625/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:19.472556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:19.576720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834b975-f62c-44ea-a767-4379983643e3 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:19.610947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:19.611556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:19.611823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:19.612100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:19.612782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:19.613118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:19.614537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b228c-4329-4d9d-aaa9-dd477046c4af None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:19.626349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 606/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:19.632383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:19.701522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:19.736502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14605639-cfe0-4984-905a-7fcda637ba17 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:19.769096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086788-be45-470f-afb5-681393268c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:19.769629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086788-be45-470f-afb5-681393268c54 None admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:19.769914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086788-be45-470f-afb5-681393268c54 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:19.770195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086788-be45-470f-afb5-681393268c54 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7eb699757f93461d8a1c29611d1204e8/roles/233dd72cb1404de5b17f49b871d6c9f4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:19.786068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086788-be45-470f-afb5-681393268c54 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=7eb699757f93461d8a1c29611d1204e8, role_id=233dd72cb1404de5b17f49b871d6c9f4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:19.787512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086788-be45-470f-afb5-681393268c54 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:19.849935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 626/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:19 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7eb699757f93461d8a1c29611d1204e8/roles/233dd72cb1404de5b17f49b871d6c9f4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:21.754660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0586b87-419e-406a-8438-33e7b9ce7ea8 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:21.755303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0586b87-419e-406a-8438-33e7b9ce7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:21.755303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0586b87-419e-406a-8438-33e7b9ce7ea8 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:21.756619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 607/1233] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:21.761683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:21.762081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:21.762242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:21.781530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:21.782561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:21.849811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 627/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:22.148748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0586b87-419e-406a-8438-33e7b9ce7ea8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.174307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:22.248889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0586b87-419e-406a-8438-33e7b9ce7ea8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.283652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.284279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.284563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.284837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.294745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:22.300606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:22.301738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:22.302584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 608/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:22.310026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.358202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:22.409997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29222aa5-e5cb-4b71-b0db-5accea0a7454 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.444619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.445249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.445534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.445810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.446470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] RBAC: Adding query filter params (name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:22.446774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:22.448140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:22.456092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 628/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:22.461952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.609402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:22.609402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9cbe-17e9-471a-85dc-6c1bbd9010a1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.609402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.609402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.610013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.610013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.613607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:22.615050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:22.629471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:22.630682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:22.631826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:22.631826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:22.631826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:22.631826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 609/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:58:22.636718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.739273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d90d9-e347-4f58-ad8d-0ff21d77cc70 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.747921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:22.774998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.776344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.776344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.776344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.776785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:22.777108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:22.778479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:22.791217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 629/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:22.799170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:22.901066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b219-37d3-49b5-b4a0-f4ba1c638b55 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:22.935083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:22.935714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:22.935995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:22.936269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:22.939466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:22.944420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:22.945913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:58:22.957996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:22.959166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:22.960424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 610/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:22.965269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:23.068493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f480a-5e57-4494-ad68-04d7fd08c3db None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:23.102846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:23.103446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:23.103727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:23.104001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:23.104729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:23.105066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:23.106538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:23.124359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 630/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 30 00:58:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:23.130549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:23.236741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088929e-01a3-4ab8-884a-2f5908c724cd None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:23.270132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:23.270740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:23.271027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:23.271307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:23.334868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:23.341332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:23.342801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:23.446456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 611/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:58:23.452549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:23.481182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:23.555114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46aa96-08a9-4170-af57-6141d6ad5b59 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:23.591119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:23.591684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:23.591970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:23.592251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:23.603045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:23.604508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:23.619424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:23.620574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:23.621763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:23.621763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:23.621763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:23.621763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 631/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:23.629619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:23.724882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:23.732357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e50e0-db76-4daf-b7a9-3c9768b7d7d9 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:23.771578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:23.772280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:23.772617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:23.772962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:23.773798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:23.774116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:23.775660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:23.788445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 612/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:23.794181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:23.872302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:23.895051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538647f-81b0-4ba9-81b0-c44697d0db9c None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:23.931073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:23.931684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:23.931974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:23.932253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:23.939559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:23.941085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:58:23.952813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:23.954153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:23.955376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:23.955934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 632/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:58:23.961546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:24.068561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fc4d1-6aa9-4390-99bf-1b611002be58 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:24.102801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:24.103398 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:24.103679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:24.103954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:24.104632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:24.104960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:24.106370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62e75-d1ea-43f6-ab82-a7972753e558 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:24.118934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 613/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:58:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:24.126031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:24.225851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc403cc3-73c9-4e01-8d38-ec7e7f036674 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:24.260306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:24.260908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:24.261222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:24.261502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:24.262231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] RBAC: Adding query filter params (role.id=233dd72cb1404de5b17f49b871d6c9f4, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7eb699757f93461d8a1c29611d1204e8) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:24.262544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:24.263990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a631f-af81-4d05-8482-ceeb99f3762b None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:24.269939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 633/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:24 2022] GET /identity/v3/role_assignments?user.id=7eb699757f93461d8a1c29611d1204e8&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=233dd72cb1404de5b17f49b871d6c9f4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:26.287101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcfd16-2a97-45c0-b15d-6528f68e3b2d None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:26.287725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcfd16-2a97-45c0-b15d-6528f68e3b2d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:26.287725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcfd16-2a97-45c0-b15d-6528f68e3b2d None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:26.289171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 614/1247] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:26.295309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:26.295736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:26.295872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:26.302963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:26.316104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:26.317351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:26.385449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 634/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:26.651207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcfd16-2a97-45c0-b15d-6528f68e3b2d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:26.669767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:26.753838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcfd16-2a97-45c0-b15d-6528f68e3b2d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:26.788509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:26.789165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:26.789449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:26.789795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:26.800620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:26.805411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:26.807387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:26.810068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 615/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:26.814568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:26.913018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517ea7e-2f49-45c8-aa12-09a35543dddc None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:26.943397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:26.948456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:26.949110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:26.949399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:26.949678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:26.950351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:26.950687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:26.952066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:26.960690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 635/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:26.966894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.048537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.072225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb2fe-fbce-4fef-a180-bde88eb75702 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.105659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.106282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.106565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.106845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.117154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:27.118610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:27.132999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:27.135422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:27.136307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:27.136307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:27.136307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:27.136307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 616/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:27.140794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.239723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5281-7294-4e15-bcd5-caa005166e75 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.276309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.276974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.277266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.277544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.278191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:27.278499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:27.279876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:27.292527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 636/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:27.298797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.399971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f698c-2909-4ab2-8a82-63fee8b3f95d None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.425730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.433359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.433987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.434267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.434542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] PATH_INFO: `/v3/users/placement` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.442565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:27.443987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:58:27.455439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:27.456504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:27.457659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 617/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:27.462494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.519786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.563247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f17225-285a-41d5-9a3c-e41a1f752e27 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.598451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.599060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.599348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.599630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.600391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:27.600705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:27.602183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:27.619450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 637/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:27.626184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:27.729948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230fd1-3a92-4eb4-9c50-af2b3bdb772f None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:27.764137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:27.764744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:27.765691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:27.765962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:27.820998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:27.834323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:27.835772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:27.930747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 618/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:58:27.936543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.045249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781adc6-8ca3-47e2-8200-642673ff5be6 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.061082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.084625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.085231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.085520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.085799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.096594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.098098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:28.113743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:28.117386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:28.118476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:28.118476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:28.118476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:28.118476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 638/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:28.120564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.208325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.221497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510fa6-062d-4bea-8640-3a1573050df1 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.255964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.256568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.256848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.258456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.258456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:28.258456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.259431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.271261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 619/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:28.277147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.377754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f442e8-cbc7-4863-8069-da857cb683a7 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.411149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.411772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.412058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.412338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.418766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.423630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:58:28.432753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:28.433833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:28.434982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 639/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:28.440514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.543461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b5d6-88ea-4c36-822e-59c352551054 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.577801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.578507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.578791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.579089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.579765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:28.580079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.581579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeaa53-e89e-471c-8c83-933de11e7406 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.594127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 620/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:28.600293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:28.625768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:28.701275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d546782-a438-4c18-b857-ba6358fcd028 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:28.735458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:28.736054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:28.736333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:28.736604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:28.737360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7eb699757f93461d8a1c29611d1204e8) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:28.737668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:28.739089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea4067-a175-40c9-9a8d-286f5a0c2c91 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:28.744452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 640/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:28 2022] GET /identity/v3/role_assignments?user.id=7eb699757f93461d8a1c29611d1204e8&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:30.677072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7655b-5d78-4bda-9d69-9f1f6446e048 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:30.677622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7655b-5d78-4bda-9d69-9f1f6446e048 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:30.677717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7655b-5d78-4bda-9d69-9f1f6446e048 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:30.679191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 621/1261] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:30.684687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:30.687887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:30.687887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:30.704557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:30.705864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:30.772571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 641/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:58:31.049674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7655b-5d78-4bda-9d69-9f1f6446e048 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.060603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.154457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7655b-5d78-4bda-9d69-9f1f6446e048 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.189148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.189784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.190067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.190345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.200768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:31.205627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:31.206806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:31.208059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 622/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:31.212864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.231651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.312891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc2dd9-107b-4092-967f-3657c9e91228 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.349652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.350263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.350548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.350823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.351489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:31.351794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:31.353243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:31.362465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 642/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:31.368295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.435929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.470236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a315-2668-4755-9e4f-b48c4902fb98 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.504071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.504704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.505034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.505315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.519094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:31.520565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:31.535714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:31.536736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:31.537677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:31.537677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:31.537677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:31.537677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 623/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:31.543065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.628719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.647704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7408d1-0e4f-4f18-bc02-92fe5773ca2d None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.681145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.681755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.682040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.682321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.682976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:31.683323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:31.684701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:31.697543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 643/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:31.704161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.806458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1540b-a8f8-44b5-9d09-8564e27b4854 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:31.826926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:31.840393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:31.841054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:31.841337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:31.841614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:31.849664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:31.851102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:58:31.862369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:31.863952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:31.865143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 624/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:31.869615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:31.973368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41293-b721-46b5-b2c9-ad1cd86c0035 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.007320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.007962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.008245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.008521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.009284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:32.009595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.011034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.023891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.040283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 644/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 30 00:58:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:32.046152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.150775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1080b-5ad9-4799-a2f8-5352a94e3ca4 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.183034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.183657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.183941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.184214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.195033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.196469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:32.211741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:32.212916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:32.214083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:32.214083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:32.214083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:32.214083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 625/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:32.218839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.318573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d2a4-7569-43e1-8d68-acae7f75f680 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.356996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.357609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.357887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.358158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.359333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:32.359633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.361021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.377745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 645/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:32.383785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.418801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.487358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892123c-bbe2-4c7a-ba1b-1746ce7b7bd7 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.520799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.521487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.521790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.522069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.528739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.533121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:58:32.541425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:32.542521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:32.543531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 626/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:32.549068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.610592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.652686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050171a-6b62-44bd-9a67-ecf913a62e2f None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.690983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.691597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.691883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.692162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.692863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:32.693204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.694779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318402a-a0fe-4745-9a42-8dddef43b84c None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:32.707000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 646/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:32.713158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:32.805573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:32.814757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2b164-ff0e-4446-95f0-de4c761016da None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:32.849434 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577d3de-ea61-4b53-8dcd-bba2121f42e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:32.850101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d3de-ea61-4b53-8dcd-bba2121f42e8 None admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:32.850391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d3de-ea61-4b53-8dcd-bba2121f42e8 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:32.850674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d3de-ea61-4b53-8dcd-bba2121f42e8 None admin] PATH_INFO: `/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7eb699757f93461d8a1c29611d1204e8/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:32.852593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d3de-ea61-4b53-8dcd-bba2121f42e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=acea582245fc4509bd1a495c97375d6d, user_id=7eb699757f93461d8a1c29611d1204e8, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:32.854104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d3de-ea61-4b53-8dcd-bba2121f42e8 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:33.052525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 627/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 30 00:58:32 2022] PUT /identity/v3/projects/acea582245fc4509bd1a495c97375d6d/users/7eb699757f93461d8a1c29611d1204e8/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:58:34.967450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c37a07-4e2e-4a29-a39c-b89199446e9b None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:34.967966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c37a07-4e2e-4a29-a39c-b89199446e9b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:34.967966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c37a07-4e2e-4a29-a39c-b89199446e9b None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:34.969467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 647/1274] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:34.975188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:34.975590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:34.975740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:34.994057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:34.995230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:35.061055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 628/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:35.335890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c37a07-4e2e-4a29-a39c-b89199446e9b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.440283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c37a07-4e2e-4a29-a39c-b89199446e9b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.457416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:35.473569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.474205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.474506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.474756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.484662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:58:35.490029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:35.491136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:35.492192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 648/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:35.497325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.579184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:35.596821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d870c-ff5e-45b3-bf8b-d53dbd26f0d3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.630698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.631308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.631591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.631870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.632529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:35.632833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:35.634420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:35.642643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 629/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:35.648508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.749690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4afb-ad30-4b19-a5d0-0904f4edfaa9 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.783313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.783924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.784204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.784478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.795026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:35.796514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:35.810708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:35.815597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:35.817276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:35.817276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:35.817276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:35.817276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 649/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:35.818975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:35.921675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596fbd-0c21-4e38-9443-ea6c770a51fa None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:35.955957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:35.956564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:35.956851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:35.957166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:35.957811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:35.958120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:35.959487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:35.971683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 630/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:58:35.977543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:36.009636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:36.087358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60dea4-e874-44a1-8276-cce252ad3960 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.125599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.126324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.126605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.126882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.134336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.135774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:58:36.147312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:36.148414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:36.149491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 650/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:36.154376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:36.158991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:36.264255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d270-5f7f-4001-acf3-0ab682626404 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.298474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.299119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.299405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.299685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.300407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:36.300717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.302187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.319933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 631/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 30 00:58:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:36.325869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:36.423831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:36.433284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb47da-90af-458a-8426-2b4c0d4329c5 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.466463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.467071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.467356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.467635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.538111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.539789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.646539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:36.659212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 651/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 30 00:58:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:58:36.665796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:36.733641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:36.777192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70407-168e-45ad-a59f-0a66eceadb17 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.816275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.816929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.817243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.817522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.829787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:36.832657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:58:36.847897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:36.854600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:58:36.855778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:58:36.855778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:58:36.855778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:36.855778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 632/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 00:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:36.856063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:36.961273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329fd3e-57ba-40e4-b5ed-e045d011e9d1 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:36.997131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:36.997793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:36.998058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:36.998338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:36.998985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:36.999293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:37.000667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:37.012278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 652/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 30 00:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:37.018858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:37.120093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff380289-c567-4b2c-a68a-60aeeac0a386 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:37.133544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:37.153571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:37.154191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:37.154473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:37.155025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:37.161698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:37.163153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:58:37.174069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:37.176127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: ERROR keystone.server.flask.application Aug 30 00:58:37.177268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 633/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 30 00:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:37.181170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:37.234019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:37.284318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66fa1-208a-459b-9ac6-c0eb7a7f766a None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:37.317445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:37.318049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:37.318336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:37.318622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:37.319317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:37.319629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:37.321103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11668d-5681-4122-ac37-b2f6ae409873 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:37.334122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 653/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 30 00:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:37.340571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:37.448912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ae6bd-57ad-4ad3-a0f5-52d39c6c9c2b None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:37.482075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:37.482675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:37.482959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:37.483234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:37.483957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] RBAC: Adding query filter params (role.id=c6c86d08ed6c422ea1eecadea6d8eb34, scope.project.id=acea582245fc4509bd1a495c97375d6d, user.id=7eb699757f93461d8a1c29611d1204e8) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:37.484270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:37.486487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb79fd-cc51-43ff-9332-1e74f5042183 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:37.492274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 634/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 30 00:58:37 2022] GET /identity/v3/role_assignments?user.id=7eb699757f93461d8a1c29611d1204e8&scope.project.id=acea582245fc4509bd1a495c97375d6d&role.id=c6c86d08ed6c422ea1eecadea6d8eb34 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:39.456006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed9ae-7359-44a2-aa75-2781abca7439 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:39.456535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed9ae-7359-44a2-aa75-2781abca7439 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:39.456535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed9ae-7359-44a2-aa75-2781abca7439 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:39.457939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 654/1288] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:39.463289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:39.463708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:39.463880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:39.482531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:39.483739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:39.519127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:39.560090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 635/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:39.830696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed9ae-7359-44a2-aa75-2781abca7439 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:39.931607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed9ae-7359-44a2-aa75-2781abca7439 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:39.944366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:39.967380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:39.968005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:39.968287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:39.968559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:39.969175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:39.970799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:39.979467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:39.980709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:39.981690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 655/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:58:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:39.987291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:40.084738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456ab07-09a1-47fb-8f2e-0d6ed5b5f5eb None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:40.118361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:40.118977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:40.119258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:40.119531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:40.120157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] RBAC: Adding query filter params (name=placement) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:40.120468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:40.121844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7142ad-f9da-47bc-9c1b-ea6b0c3452ab None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:40.128004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 636/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 30 00:58:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:40.133950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:40.234484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c26a-a84d-4c30-b6b7-b3e4d4466723 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:40.267988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:40.268551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:40.268830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:40.269131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] PATH_INFO: `/v3/services` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:40.269758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:40.270058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:40.271424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea692ab-8e00-4ff7-80de-38dcca2758c5 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:40.275767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 656/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 30 00:58:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:42.163928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221e49-49fc-48cd-b82e-c4dc091aa63a None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.164460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221e49-49fc-48cd-b82e-c4dc091aa63a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.164460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221e49-49fc-48cd-b82e-c4dc091aa63a None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.165864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 637/1293] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:42.171164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695355-012a-4db0-a5ea-43f8b2884924 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.171813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695355-012a-4db0-a5ea-43f8b2884924 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.172080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695355-012a-4db0-a5ea-43f8b2884924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.190626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-93695355-012a-4db0-a5ea-43f8b2884924 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:42.191875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-93695355-012a-4db0-a5ea-43f8b2884924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:42.222433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:42.261639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 657/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:42.535444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221e49-49fc-48cd-b82e-c4dc091aa63a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:42.567781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:42.638133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221e49-49fc-48cd-b82e-c4dc091aa63a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:42.671678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141f0e1-9e3a-483f-bb77-678878f3bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:42.672286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f0e1-9e3a-483f-bb77-678878f3bc3c None admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:42.672569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f0e1-9e3a-483f-bb77-678878f3bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:42.676984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f0e1-9e3a-483f-bb77-678878f3bc3c None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:42.677703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141f0e1-9e3a-483f-bb77-678878f3bc3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:42.679094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141f0e1-9e3a-483f-bb77-678878f3bc3c None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:42.827714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 638/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 30 00:58:42 2022] POST /identity/v3/services => generated 246 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:44.811530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21c6ed-c311-4bdf-81cd-30c7d76f39c2 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.812076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21c6ed-c311-4bdf-81cd-30c7d76f39c2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.812076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21c6ed-c311-4bdf-81cd-30c7d76f39c2 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.814311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 658/1296] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:44.819859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:44.820343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:44.820442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:44.839688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:44.840876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:44.913806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 639/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:45.191375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21c6ed-c311-4bdf-81cd-30c7d76f39c2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.292330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21c6ed-c311-4bdf-81cd-30c7d76f39c2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.326642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.327275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.327560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.327842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] PATH_INFO: `/v3/services/placement` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.328425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.330640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:45.339440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:45.340686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:45.341631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 659/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:45.347582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.365644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.446720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c61a-61dc-406e-ab41-3c9a8df68877 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.483454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.484063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.484346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.484624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.485286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] RBAC: Adding query filter params (name=placement) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:45.486183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.488042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.493169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 640/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.499143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.531772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.601449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a384-e49c-4c53-afbe-7867244fe854 None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.639934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.640537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.640832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.641170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.641888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] RBAC: Adding query filter params (interface=public, service_id=9829259851fb4a44a5edccbaacc2d753, region_id=RegionOne) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:45.642200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.643645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81c42-70c2-4e4a-ac7d-8874dd2b0dc7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.648594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 660/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/endpoints?service_id=9829259851fb4a44a5edccbaacc2d753&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:45.654745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:45.738725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:45.756202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba68b22-c9e1-4bc3-bb1e-c5efa73d6690 None admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:45.790614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a0dc1-402f-48bd-9c90-08c2b7b0a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:45.791227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a0dc1-402f-48bd-9c90-08c2b7b0a123 None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:45.791513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a0dc1-402f-48bd-9c90-08c2b7b0a123 None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:45.791794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a0dc1-402f-48bd-9c90-08c2b7b0a123 None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:45.792454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a0dc1-402f-48bd-9c90-08c2b7b0a123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:45.794122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a0dc1-402f-48bd-9c90-08c2b7b0a123 None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:45.802351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 641/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 30 00:58:45 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:58:47.725857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba06-fd32-4752-a73b-f32856a30fcd None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.726378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba06-fd32-4752-a73b-f32856a30fcd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.726485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba06-fd32-4752-a73b-f32856a30fcd None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.727767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 661/1302] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:58:47.732882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:47.734978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:47.734978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:47.751918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:58:47.753240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:58:47.844617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 642/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 00:58:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:58:48.109955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2ba06-fd32-4752-a73b-f32856a30fcd None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.218565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.225539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2ba06-fd32-4752-a73b-f32856a30fcd None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.259355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.259980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.260262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.260538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] PATH_INFO: `/v3/services/placement` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.261142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.262624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:58:48.271968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:58:48.273000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application with Lock( Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: ERROR keystone.server.flask.application Aug 30 00:58:48.273849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 662/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:58:48.279101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.361601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.385371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc55ca9-a8b6-4eeb-83a9-fb1ac5a977a4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.419558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.420232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.420519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.420801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] PATH_INFO: `/v3/services` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.421460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:58:48.421769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.423871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca46245-354c-4d79-b3ac-d4ed035535ec None admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.429046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 643/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 30 00:58:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:58:48.436539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:58:48.545244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3f1e8-68cc-4a99-bb3b-bd9ecc0f2bce None admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:58:48.580266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa0c02-8733-4427-afda-b8080fcd4ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:58:48.585340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa0c02-8733-4427-afda-b8080fcd4ba7 None admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:58:48.585340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa0c02-8733-4427-afda-b8080fcd4ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:58:48.585340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa0c02-8733-4427-afda-b8080fcd4ba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:58:48.585340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa0c02-8733-4427-afda-b8080fcd4ba7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:58:48.585340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa0c02-8733-4427-afda-b8080fcd4ba7 None admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:58:48.697740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 663/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 00:58:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:58:58.425950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=30 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:58.692850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:31.883405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47f89-8e3e-4c2d-bf4f-cd939d5ff12f None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:31.884483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47f89-8e3e-4c2d-bf4f-cd939d5ff12f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:31.885067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47f89-8e3e-4c2d-bf4f-cd939d5ff12f None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:31.894988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f435ba-4e14-40cd-830e-eb258119b93b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:31.894988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f435ba-4e14-40cd-830e-eb258119b93b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:31.894988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f435ba-4e14-40cd-830e-eb258119b93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:31.898797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 644/1307] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:31 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:31.983812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-41f435ba-4e14-40cd-830e-eb258119b93b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:31.985059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-41f435ba-4e14-40cd-830e-eb258119b93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.109765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 664/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:32.436539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc8033-3766-4b4d-9e9b-c59c91d296f0 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.437251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc8033-3766-4b4d-9e9b-c59c91d296f0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.437742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc8033-3766-4b4d-9e9b-c59c91d296f0 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.439598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 645/1309] 10.222.0.16 () {54 vars in 965 bytes} [Tue Aug 30 01:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:32.447653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5cbd-01f0-4114-8f92-98d239714a01 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.447953 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5cbd-01f0-4114-8f92-98d239714a01 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.448239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5cbd-01f0-4114-8f92-98d239714a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.556705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-581d5cbd-01f0-4114-8f92-98d239714a01 None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:32.557971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-581d5cbd-01f0-4114-8f92-98d239714a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.580713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:32.651236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 665/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 30 01:05:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:32.660989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc8033-3766-4b4d-9e9b-c59c91d296f0 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:32.663136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-acbc8033-3766-4b4d-9e9b-c59c91d296f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.813371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc8033-3766-4b4d-9e9b-c59c91d296f0 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:32.896827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:32.897853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:32.897853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:32.898220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:32.901272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:32.970288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:33.030930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:33.032299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88fa9-4c95-4899-992d-a85223fbf35a service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:33.056764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 646/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:35.344539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f616a0-da39-4274-9659-779484a206a0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:35.345112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f616a0-da39-4274-9659-779484a206a0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:35.345112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f616a0-da39-4274-9659-779484a206a0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:35.346492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 666/1312] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:35.352097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419213-5321-474a-9bb9-e971297c49da None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:35.352493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419213-5321-474a-9bb9-e971297c49da None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:35.352789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419213-5321-474a-9bb9-e971297c49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:35.442766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c4419213-5321-474a-9bb9-e971297c49da None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:35.444029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c4419213-5321-474a-9bb9-e971297c49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:35.557477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 647/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:35.841628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f616a0-da39-4274-9659-779484a206a0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:35.843189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-00f616a0-da39-4274-9659-779484a206a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:35.952215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f616a0-da39-4274-9659-779484a206a0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:36.029997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:36.032960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:36.033582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:36.033870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:36.034153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:36.035795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:36.146055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:36.147423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470f4e-37fb-4ce6-93fe-a38e2ca3f89e service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:36.165670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 667/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:38.644159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e782d-3b60-476d-86d7-42a25fdb14b3 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:38.644719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e782d-3b60-476d-86d7-42a25fdb14b3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:38.644719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e782d-3b60-476d-86d7-42a25fdb14b3 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:38.646071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 648/1315] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:38.651089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef39d-7433-457d-a6fe-b44a36c46d73 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:38.651516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef39d-7433-457d-a6fe-b44a36c46d73 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:38.651651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef39d-7433-457d-a6fe-b44a36c46d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:38.718847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-1f4ef39d-7433-457d-a6fe-b44a36c46d73 None None] MFA Rules not processed for user `ea84489dac76463baccf51829ef3a571`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:38.720073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1f4ef39d-7433-457d-a6fe-b44a36c46d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:38.772591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:38.816728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 668/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:39.114704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e782d-3b60-476d-86d7-42a25fdb14b3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:39.116260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f71e782d-3b60-476d-86d7-42a25fdb14b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:39.127201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:39.223000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e782d-3b60-476d-86d7-42a25fdb14b3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:39.295551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:39.296186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:39.296523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:39.296802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:39.298444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:39.361866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:39.408840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:39.410382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da7d5b-b210-4a47-aea2-c762c771ec61 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:39.429033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 649/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:42.329636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ca9-62d3-4063-ba96-73bb6adc7cc7 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:42.330175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ca9-62d3-4063-ba96-73bb6adc7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:42.330265 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866ca9-62d3-4063-ba96-73bb6adc7cc7 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:42.331616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 669/1318] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:42.336693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3dcd7-b03a-49d8-9c9e-1a641f065780 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:42.337179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3dcd7-b03a-49d8-9c9e-1a641f065780 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:42.337285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3dcd7-b03a-49d8-9c9e-1a641f065780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:42.406000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c4d3dcd7-b03a-49d8-9c9e-1a641f065780 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:42.407214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c4d3dcd7-b03a-49d8-9c9e-1a641f065780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:42.502512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 650/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:42.793337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866ca9-62d3-4063-ba96-73bb6adc7cc7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:42.794898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-03866ca9-62d3-4063-ba96-73bb6adc7cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:42.899244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866ca9-62d3-4063-ba96-73bb6adc7cc7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:42.975224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:42.975830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:42.976114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:42.976393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:42.978035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:42.985553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:43.090952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:43.092348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a899ae0-3950-4969-98bc-4043dd0dee25 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:43.110875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 670/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:46.098562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb974c-1fbc-4cf7-a5a1-b6c5b5efa834 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:46.099078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb974c-1fbc-4cf7-a5a1-b6c5b5efa834 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:46.099078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb974c-1fbc-4cf7-a5a1-b6c5b5efa834 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:46.100416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 651/1321] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:46.105672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396950fb-e3d1-4973-9049-44328cf3a579 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:46.106134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396950fb-e3d1-4973-9049-44328cf3a579 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:46.106429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396950fb-e3d1-4973-9049-44328cf3a579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:46.174512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-396950fb-e3d1-4973-9049-44328cf3a579 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:46.175750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-396950fb-e3d1-4973-9049-44328cf3a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:46.237957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:46.279745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 671/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:46.570563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb974c-1fbc-4cf7-a5a1-b6c5b5efa834 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:46.572541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3fcb974c-1fbc-4cf7-a5a1-b6c5b5efa834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:46.596244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:46.691573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb974c-1fbc-4cf7-a5a1-b6c5b5efa834 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:46.772804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:46.773380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:46.773666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:46.773945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:46.775586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:46.850700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:46.887644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:46.889628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8777-22f3-4139-98b6-a13ed6a6f5f0 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:46.911337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 652/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:48.912431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da691-a89c-463a-b352-0029613a62cf None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:48.912985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da691-a89c-463a-b352-0029613a62cf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:48.912985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da691-a89c-463a-b352-0029613a62cf None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:48.914302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 672/1324] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:48.919667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa63ab-765f-443d-9f8a-9166a041e534 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:48.921086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa63ab-765f-443d-9f8a-9166a041e534 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:48.921380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa63ab-765f-443d-9f8a-9166a041e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:48.991114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-fcfa63ab-765f-443d-9f8a-9166a041e534 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:48.992329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fcfa63ab-765f-443d-9f8a-9166a041e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:49.099353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 653/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:49.392278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da691-a89c-463a-b352-0029613a62cf None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:49.393948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-104da691-a89c-463a-b352-0029613a62cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:49.507909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da691-a89c-463a-b352-0029613a62cf None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:49.584766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:49.585476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:49.585762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:49.586043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:49.587663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:49.605438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:49.709636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:49.711135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f89b6-a77c-42d0-b566-6e2e8f253ae9 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:49.729481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 673/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:51.737969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928138fb-6826-43b4-ab9f-c0611eaf4f67 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:51.738499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928138fb-6826-43b4-ab9f-c0611eaf4f67 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:51.738588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928138fb-6826-43b4-ab9f-c0611eaf4f67 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:51.739884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 654/1327] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:51.745164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c60e9-bfb3-4278-a3e4-9547f89546e4 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:51.745584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c60e9-bfb3-4278-a3e4-9547f89546e4 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:51.745731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c60e9-bfb3-4278-a3e4-9547f89546e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:51.823337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-685c60e9-bfb3-4278-a3e4-9547f89546e4 None None] MFA Rules not processed for user `ea84489dac76463baccf51829ef3a571`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:51.824593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-685c60e9-bfb3-4278-a3e4-9547f89546e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:51.896685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:51.932015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 674/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:05:52.233508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358ff3-e43a-4b57-99e8-828ddb3d9e3f None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:52.233789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358ff3-e43a-4b57-99e8-828ddb3d9e3f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:52.234076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358ff3-e43a-4b57-99e8-828ddb3d9e3f None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:52.235518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 655/1329] 10.222.0.16 () {54 vars in 965 bytes} [Tue Aug 30 01:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:52.241874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac07923-eb73-4b26-9bbe-789c3d959348 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:52.242237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac07923-eb73-4b26-9bbe-789c3d959348 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:52.242580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac07923-eb73-4b26-9bbe-789c3d959348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:52.337143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9ac07923-eb73-4b26-9bbe-789c3d959348 None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:52.339510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9ac07923-eb73-4b26-9bbe-789c3d959348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.428668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 675/1330] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 30 01:05:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:52.438494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358ff3-e43a-4b57-99e8-828ddb3d9e3f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:52.440026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-17358ff3-e43a-4b57-99e8-828ddb3d9e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.471905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:52.549265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17358ff3-e43a-4b57-99e8-828ddb3d9e3f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:52.625722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:52.626339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:52.626616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:52.626887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:52.628491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:52.707853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:52.739953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:52.741436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c25131-99d4-41f3-bdd5-ff35ef3f1000 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:52.759569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 656/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:55.484957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025ccd2-7ef9-480e-ba7d-866d0d0bb385 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:55.485566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025ccd2-7ef9-480e-ba7d-866d0d0bb385 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:55.485566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025ccd2-7ef9-480e-ba7d-866d0d0bb385 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:55.486867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 676/1332] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:55.492169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a707c2-57f3-49aa-a04b-fcc78fa6cf20 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:55.492604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a707c2-57f3-49aa-a04b-fcc78fa6cf20 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:55.492730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a707c2-57f3-49aa-a04b-fcc78fa6cf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:55.559767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-18a707c2-57f3-49aa-a04b-fcc78fa6cf20 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:55.561129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-18a707c2-57f3-49aa-a04b-fcc78fa6cf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:55.657001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 657/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:55.942209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025ccd2-7ef9-480e-ba7d-866d0d0bb385 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:55.943790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5025ccd2-7ef9-480e-ba7d-866d0d0bb385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:56.016259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:56.049937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025ccd2-7ef9-480e-ba7d-866d0d0bb385 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:56.126465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:56.126997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:56.127280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:56.127561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:56.129214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:56.246155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:56.248509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e6f45-1290-4112-af66-86acc2893fe7 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:56.258440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:56.267960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 677/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:05:58.251269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52158-b239-40d1-8dfa-3f852e72f0d6 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:58.251794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52158-b239-40d1-8dfa-3f852e72f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:58.251907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52158-b239-40d1-8dfa-3f852e72f0d6 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:58.253203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 658/1335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:05:58.258461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f577-b295-4c13-9fc0-9eba2c277e5a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:58.258871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f577-b295-4c13-9fc0-9eba2c277e5a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:58.259018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f577-b295-4c13-9fc0-9eba2c277e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:58.328644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-63e0f577-b295-4c13-9fc0-9eba2c277e5a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:05:58.329902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-63e0f577-b295-4c13-9fc0-9eba2c277e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:58.430806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 678/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:05:58.720331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb52158-b239-40d1-8dfa-3f852e72f0d6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:05:58.721902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-dcb52158-b239-40d1-8dfa-3f852e72f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:58.765382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:58.836194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb52158-b239-40d1-8dfa-3f852e72f0d6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:05:58.916380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:05:58.917007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:05:58.917292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:05:58.917568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:05:58.919292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:05:59.120263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:59.157884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:05:59.159349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80cbf1-929e-4d4c-a900-eeac88b8a017 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:05:59.178377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 659/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:01.828246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e09f-91c0-432f-a61a-30d6c08ae3c0 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:01.828648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e09f-91c0-432f-a61a-30d6c08ae3c0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:01.828807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e09f-91c0-432f-a61a-30d6c08ae3c0 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:01.830185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 679/1338] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:01.835288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a02e79-929e-4c67-ac20-3f32ae224768 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:01.835674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a02e79-929e-4c67-ac20-3f32ae224768 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:01.835833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a02e79-929e-4c67-ac20-3f32ae224768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:01.907663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e0a02e79-929e-4c67-ac20-3f32ae224768 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:01.909395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e0a02e79-929e-4c67-ac20-3f32ae224768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:02.030253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 660/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:02.397981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e09f-91c0-432f-a61a-30d6c08ae3c0 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:02.402394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f855e09f-91c0-432f-a61a-30d6c08ae3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:02.520221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:02.556536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e09f-91c0-432f-a61a-30d6c08ae3c0 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:02.654338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:02.654988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:02.656019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:02.656019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:02.660323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:02.797831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:02.799294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59486830-c193-4630-b8c6-57926dbbdd60 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:02.817740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 680/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:07.010517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305da7-5332-48ff-9f91-c2324878d165 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:07.011078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305da7-5332-48ff-9f91-c2324878d165 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:07.011078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305da7-5332-48ff-9f91-c2324878d165 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:07.012421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 661/1341] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:07.018398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847986-ae0c-45d7-bf9f-c5727b7a9614 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:07.018864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847986-ae0c-45d7-bf9f-c5727b7a9614 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:07.018969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a847986-ae0c-45d7-bf9f-c5727b7a9614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:07.024357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:07.088171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7a847986-ae0c-45d7-bf9f-c5727b7a9614 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:07.089457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7a847986-ae0c-45d7-bf9f-c5727b7a9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:07.191363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 681/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:07.494446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305da7-5332-48ff-9f91-c2324878d165 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:07.496068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-43305da7-5332-48ff-9f91-c2324878d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:07.550505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:07.608714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305da7-5332-48ff-9f91-c2324878d165 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:07.690375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:07.690991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:07.691270 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:07.691542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:07.693191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:07.791349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:07.807863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:07.809383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa412e-4d18-487a-884d-9a76cc58f821 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:07.830513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 662/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:10.749913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5cff9-4879-4c1f-93a3-0385d0443feb None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.750474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5cff9-4879-4c1f-93a3-0385d0443feb None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.750474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5cff9-4879-4c1f-93a3-0385d0443feb None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.751880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 682/1344] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:10.757273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968c33b-37a8-48bc-8ce1-abe3dcc23bc3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:10.757668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968c33b-37a8-48bc-8ce1-abe3dcc23bc3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:10.757827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968c33b-37a8-48bc-8ce1-abe3dcc23bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:10.832088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b968c33b-37a8-48bc-8ce1-abe3dcc23bc3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:10.833336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b968c33b-37a8-48bc-8ce1-abe3dcc23bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:10.942621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 663/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:11.228135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5cff9-4879-4c1f-93a3-0385d0443feb None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:11.229785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-60a5cff9-4879-4c1f-93a3-0385d0443feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:11.328914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:11.349309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5cff9-4879-4c1f-93a3-0385d0443feb None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:11.437323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:11.437869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:11.438151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:11.438428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:11.440166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:11.563016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:11.564508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058d29-c0c2-41fb-a4ee-5c56312033f1 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:11.589679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 683/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:16.036205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f36678-d5ee-4c35-82df-7f5249ebc7f9 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:16.036728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f36678-d5ee-4c35-82df-7f5249ebc7f9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:16.037104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f36678-d5ee-4c35-82df-7f5249ebc7f9 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:16.038595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 664/1347] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:16.045325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d2c06-4b58-4351-9d17-5b0e0340213f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:16.045750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d2c06-4b58-4351-9d17-5b0e0340213f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:16.045750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d2c06-4b58-4351-9d17-5b0e0340213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:16.064719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:16.126868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7b7d2c06-4b58-4351-9d17-5b0e0340213f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:16.128113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7b7d2c06-4b58-4351-9d17-5b0e0340213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:16.242197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 684/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:16.527507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f36678-d5ee-4c35-82df-7f5249ebc7f9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:16.529248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-93f36678-d5ee-4c35-82df-7f5249ebc7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:16.596442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:16.650417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f36678-d5ee-4c35-82df-7f5249ebc7f9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:16.728263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:16.728879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:16.729209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:16.729474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:16.731085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:16.843477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:16.847192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:16.848610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd1d71-3a12-430c-8d0d-87c18cb5d351 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:16.867280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 665/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:21.952328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0578272-d3d6-47b7-b8fc-68ef77921508 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:21.952877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0578272-d3d6-47b7-b8fc-68ef77921508 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:21.953424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0578272-d3d6-47b7-b8fc-68ef77921508 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:21.955183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 685/1350] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:21.961134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472fc81-518b-4b55-b74c-b2cab612081f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:21.961557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472fc81-518b-4b55-b74c-b2cab612081f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:21.961811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472fc81-518b-4b55-b74c-b2cab612081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:22.062719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c472fc81-518b-4b55-b74c-b2cab612081f None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:22.064886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c472fc81-518b-4b55-b74c-b2cab612081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:22.250297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 666/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:06:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:26.239848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=59 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:26.805861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052da3-b9cd-41bb-a1cf-4dbb8527de19 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:26.806233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052da3-b9cd-41bb-a1cf-4dbb8527de19 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:26.806748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052da3-b9cd-41bb-a1cf-4dbb8527de19 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:26.808218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 686/1352] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:26.813351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643bc0-c643-47b3-99c3-835dca89ea56 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:26.814173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643bc0-c643-47b3-99c3-835dca89ea56 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:26.814614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94643bc0-c643-47b3-99c3-835dca89ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:26.883305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:26.921701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-94643bc0-c643-47b3-99c3-835dca89ea56 None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:26.922934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-94643bc0-c643-47b3-99c3-835dca89ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:27.061210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 667/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:28.180418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7330-a6a5-455a-8bd9-8f66075f0994 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:28.180908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7330-a6a5-455a-8bd9-8f66075f0994 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:28.180908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7330-a6a5-455a-8bd9-8f66075f0994 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:28.182238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 687/1354] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:28.188622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07c5b-40d0-4605-9841-7335d5f4ca00 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:28.189162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07c5b-40d0-4605-9841-7335d5f4ca00 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:28.189265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07c5b-40d0-4605-9841-7335d5f4ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:28.281065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-38a07c5b-40d0-4605-9841-7335d5f4ca00 None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:28.282294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-38a07c5b-40d0-4605-9841-7335d5f4ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:28.333984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:28.419901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 668/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:31.894240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d871-4678-4d9f-bc66-8d98564e877a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:31.894760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d871-4678-4d9f-bc66-8d98564e877a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:31.894865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d871-4678-4d9f-bc66-8d98564e877a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:31.896143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 688/1356] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:31.901525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bb5a-955b-45ae-83d3-53d07b384cf7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:31.901954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bb5a-955b-45ae-83d3-53d07b384cf7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:31.902111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bb5a-955b-45ae-83d3-53d07b384cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:31.990201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b7e8bb5a-955b-45ae-83d3-53d07b384cf7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:31.991419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b7e8bb5a-955b-45ae-83d3-53d07b384cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:32.127720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 669/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:32.431972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af35ab-18f4-4209-9649-73f7e0f0acad None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:32.433841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af35ab-18f4-4209-9649-73f7e0f0acad None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:32.435690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af35ab-18f4-4209-9649-73f7e0f0acad None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:32.439789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 689/1358] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 30 01:06:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:32.446596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa838-31d6-47b4-b495-2eb4854765f0 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:32.447679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa838-31d6-47b4-b495-2eb4854765f0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:32.448212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa838-31d6-47b4-b495-2eb4854765f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:32.467830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:32.540131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-aecfa838-31d6-47b4-b495-2eb4854765f0 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:32.541486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-aecfa838-31d6-47b4-b495-2eb4854765f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:32.670868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 670/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 30 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:32.679023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af35ab-18f4-4209-9649-73f7e0f0acad None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:32.680990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f4af35ab-18f4-4209-9649-73f7e0f0acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:32.867983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af35ab-18f4-4209-9649-73f7e0f0acad None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:32.954420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:33.001757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:33.002385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:33.002733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:33.003013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:33.005411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:33.105589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:33.107280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e4f08-b0b0-497c-ae98-b267d10092fa service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:33.126936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 690/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:35.308766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4ec4-7c6a-4929-8b86-5eff9a85dce3 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:35.309513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4ec4-7c6a-4929-8b86-5eff9a85dce3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:35.309513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4ec4-7c6a-4929-8b86-5eff9a85dce3 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:35.310997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 671/1361] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:35.316041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c631c-fe00-4d76-b085-0ee3b82e82b1 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:35.316429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c631c-fe00-4d76-b085-0ee3b82e82b1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:35.316599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c631c-fe00-4d76-b085-0ee3b82e82b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:35.397041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-465c631c-fe00-4d76-b085-0ee3b82e82b1 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:35.398268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-465c631c-fe00-4d76-b085-0ee3b82e82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:35.440447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:35.509505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 691/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:35.810919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4ec4-7c6a-4929-8b86-5eff9a85dce3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:35.812379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b93b4ec4-7c6a-4929-8b86-5eff9a85dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:35.885919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:35.972073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4ec4-7c6a-4929-8b86-5eff9a85dce3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:36.104646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:36.105295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:36.105595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:36.105957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:36.107525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:36.136224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:36.232655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:36.234530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42670251-4711-4ea3-9fac-1ed5d108eb1c service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:36.256786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 672/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:38.807435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567b97e-f167-476d-a4dc-83f73323a495 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:38.807951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567b97e-f167-476d-a4dc-83f73323a495 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:38.807951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567b97e-f167-476d-a4dc-83f73323a495 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:38.809351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 692/1364] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:38.814775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab369-66da-42d3-b9fc-1817e66c3747 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:38.815240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab369-66da-42d3-b9fc-1817e66c3747 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:38.815360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab369-66da-42d3-b9fc-1817e66c3747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:38.888039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-120ab369-66da-42d3-b9fc-1817e66c3747 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:38.889315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-120ab369-66da-42d3-b9fc-1817e66c3747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:38.997666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:39.005115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 673/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:39.300951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a89fc-376f-474b-9ce3-7fb26d94d44e None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:39.301398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a89fc-376f-474b-9ce3-7fb26d94d44e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:39.301779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a89fc-376f-474b-9ce3-7fb26d94d44e None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:39.303367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 693/1366] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 30 01:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:39.309990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c548b8-b3ac-49bd-bbac-7da806630b5f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:39.310412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c548b8-b3ac-49bd-bbac-7da806630b5f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:39.310705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c548b8-b3ac-49bd-bbac-7da806630b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:39.397123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-69c548b8-b3ac-49bd-bbac-7da806630b5f None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:39.398358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-69c548b8-b3ac-49bd-bbac-7da806630b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:39.529026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 674/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 30 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:39.538583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a89fc-376f-474b-9ce3-7fb26d94d44e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:39.540262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e64a89fc-376f-474b-9ce3-7fb26d94d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:39.724327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a89fc-376f-474b-9ce3-7fb26d94d44e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:39.746974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:39.843786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:39.844420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:39.844706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:39.844888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:39.846485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:39.940062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:39.941692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f7212-b359-4cc1-9099-257e2c7ebd4c service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:39.961853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 694/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:40.202529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd46f-280a-4303-a187-5c5f85cac929 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:40.203042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd46f-280a-4303-a187-5c5f85cac929 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:40.203042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd46f-280a-4303-a187-5c5f85cac929 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:40.204531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 675/1369] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:40.210138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70ca40-ee12-4b4e-a628-802544be1365 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:40.213192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70ca40-ee12-4b4e-a628-802544be1365 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:40.213192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70ca40-ee12-4b4e-a628-802544be1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:40.247900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:40.284364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ef70ca40-ee12-4b4e-a628-802544be1365 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:40.285645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ef70ca40-ee12-4b4e-a628-802544be1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:40.397710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 695/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:41.005306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13faf8-47b3-4c8e-afad-9d7a1e93ced5 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:41.005688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13faf8-47b3-4c8e-afad-9d7a1e93ced5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:41.006047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13faf8-47b3-4c8e-afad-9d7a1e93ced5 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:41.007696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 676/1371] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 30 01:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:41.013441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedd539-ebf4-4873-b428-64536cdb5d35 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:41.014832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedd539-ebf4-4873-b428-64536cdb5d35 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:41.015193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedd539-ebf4-4873-b428-64536cdb5d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:41.109291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-daedd539-ebf4-4873-b428-64536cdb5d35 None None] MFA Rules not processed for user `37d12b58ffac40e8a90d32748f470a61`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:41.110634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-daedd539-ebf4-4873-b428-64536cdb5d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:41.161783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:41.217635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 696/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Aug 30 01:06:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:41.225725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13faf8-47b3-4c8e-afad-9d7a1e93ced5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:41.227393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cb13faf8-47b3-4c8e-afad-9d7a1e93ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:41.281199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:41.340686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13faf8-47b3-4c8e-afad-9d7a1e93ced5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:41.429355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:41.429991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:41.430278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:41.430558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:41.432277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:41.539622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:41.555596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:41.558380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626bbc4-0ece-4e05-901d-edfecbf7f760 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:41.583607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 677/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:06:42.309962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d72f-4958-4dff-95d5-ef03bad42d54 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:42.310479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d72f-4958-4dff-95d5-ef03bad42d54 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:42.310592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d72f-4958-4dff-95d5-ef03bad42d54 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:42.311871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 697/1374] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:42.317467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfbb86-0448-496e-bc68-fd1d48c017a9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:42.317939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfbb86-0448-496e-bc68-fd1d48c017a9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:42.318035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfbb86-0448-496e-bc68-fd1d48c017a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:42.386102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2fcfbb86-0448-496e-bc68-fd1d48c017a9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:42.387494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2fcfbb86-0448-496e-bc68-fd1d48c017a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:42.489279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 678/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:42.798253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d72f-4958-4dff-95d5-ef03bad42d54 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:42.799780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d925d72f-4958-4dff-95d5-ef03bad42d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:42.952656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d72f-4958-4dff-95d5-ef03bad42d54 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:43.013202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:43.081320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:43.081972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:43.082265 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:43.082548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:43.084251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:43.180828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:43.182341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145fe13-4134-4a58-93f5-8823e7b50d80 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:43.201671 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 698/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:45.372657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655d1e-d6f1-40e9-8d96-a65c724a4ad5 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:45.373216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655d1e-d6f1-40e9-8d96-a65c724a4ad5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:45.373216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655d1e-d6f1-40e9-8d96-a65c724a4ad5 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:45.379673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 679/1377] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:45.381279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f63ce-e64f-46ec-8eb6-f46c684b630d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:45.381736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f63ce-e64f-46ec-8eb6-f46c684b630d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:45.381827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f63ce-e64f-46ec-8eb6-f46c684b630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:45.461511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a14f63ce-e64f-46ec-8eb6-f46c684b630d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:45.462894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a14f63ce-e64f-46ec-8eb6-f46c684b630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:45.470517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:45.577686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 699/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:45.898575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655d1e-d6f1-40e9-8d96-a65c724a4ad5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:45.900154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9f655d1e-d6f1-40e9-8d96-a65c724a4ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:45.967427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:46.062214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655d1e-d6f1-40e9-8d96-a65c724a4ad5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:46.199550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:46.200117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:46.200240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:46.200496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:46.202159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:46.221967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:46.300360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:46.302002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab423e-6297-49c8-85d8-a01f3ee08455 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:46.321881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 680/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:48.433228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f908a-832d-4323-b25a-406d2d12ed4f None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:48.434905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f908a-832d-4323-b25a-406d2d12ed4f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:48.435203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f908a-832d-4323-b25a-406d2d12ed4f None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:48.436782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 700/1380] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:48.442129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad0f7-4484-46f6-8e2b-1fc739919215 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:48.442645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad0f7-4484-46f6-8e2b-1fc739919215 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:48.442755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad0f7-4484-46f6-8e2b-1fc739919215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:48.532009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ea2ad0f7-4484-46f6-8e2b-1fc739919215 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:48.533249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ea2ad0f7-4484-46f6-8e2b-1fc739919215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:48.634935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:48.642727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 681/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:48.945742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f908a-832d-4323-b25a-406d2d12ed4f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:48.948438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-147f908a-832d-4323-b25a-406d2d12ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:49.107574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:49.119723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f908a-832d-4323-b25a-406d2d12ed4f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:49.238415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:49.238944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:49.239227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:49.239496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:49.241173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:49.342385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:49.344016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03924517-24cf-43fb-9723-cc12d0b4329f service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:49.354920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:49.365345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 701/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:51.954097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa60456-d8da-4c4d-a7bb-87413da4c2e0 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:51.954626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa60456-d8da-4c4d-a7bb-87413da4c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:51.954747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa60456-d8da-4c4d-a7bb-87413da4c2e0 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:51.956120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 682/1383] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:51.962493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f68c-1680-4619-af2e-3bc6a6294022 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:51.962908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f68c-1680-4619-af2e-3bc6a6294022 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:51.963267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5f68c-1680-4619-af2e-3bc6a6294022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:52.042394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-cdc5f68c-1680-4619-af2e-3bc6a6294022 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:52.044553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cdc5f68c-1680-4619-af2e-3bc6a6294022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:52.162597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 702/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:52.462925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa60456-d8da-4c4d-a7bb-87413da4c2e0 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:52.471973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9fa60456-d8da-4c4d-a7bb-87413da4c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:52.624173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa60456-d8da-4c4d-a7bb-87413da4c2e0 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:52.702780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:52.765843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:52.766608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:52.767030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:52.767383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:52.769725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:52.884876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:52.886731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a36a13-7df1-435c-9060-0ad5081947e9 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:52.909929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 683/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:06:54.981235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06738-987b-4aec-b388-59dbfdad47f2 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:54.981748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06738-987b-4aec-b388-59dbfdad47f2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:54.981898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06738-987b-4aec-b388-59dbfdad47f2 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:54.983320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 703/1386] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:54.988858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433543b6-39d7-475a-8498-c02f9c436507 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:54.989289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433543b6-39d7-475a-8498-c02f9c436507 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:54.989457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433543b6-39d7-475a-8498-c02f9c436507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:55.060884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-433543b6-39d7-475a-8498-c02f9c436507 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:55.062266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-433543b6-39d7-475a-8498-c02f9c436507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:55.103239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:55.174237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 684/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:55.474386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac06738-987b-4aec-b388-59dbfdad47f2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:55.476351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3ac06738-987b-4aec-b388-59dbfdad47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:55.574519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:55.648902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac06738-987b-4aec-b388-59dbfdad47f2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:55.764283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e653e1-1291-463d-951d-429764958d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:55.764909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e653e1-1291-463d-951d-429764958d59 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:55.765285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e653e1-1291-463d-951d-429764958d59 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:55.765568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e653e1-1291-463d-951d-429764958d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:55.767254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-36e653e1-1291-463d-951d-429764958d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:55.811631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:55.866875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e653e1-1291-463d-951d-429764958d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:55.868729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e653e1-1291-463d-951d-429764958d59 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:55.888459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 704/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:57.543996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200896dd-577a-4e44-ba81-4e7f4548cff1 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:57.544558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200896dd-577a-4e44-ba81-4e7f4548cff1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:57.544558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200896dd-577a-4e44-ba81-4e7f4548cff1 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:57.545934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 685/1389] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:57.551257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c72453-39a0-4dcb-8655-bc9d9e57bc0c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:57.551716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c72453-39a0-4dcb-8655-bc9d9e57bc0c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:57.551823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c72453-39a0-4dcb-8655-bc9d9e57bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:57.620858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-03c72453-39a0-4dcb-8655-bc9d9e57bc0c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:57.622647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-03c72453-39a0-4dcb-8655-bc9d9e57bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:57.718804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 705/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:58.034894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def0b3-78f9-4b1e-8b01-6dbca24e19a8 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:58.035310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def0b3-78f9-4b1e-8b01-6dbca24e19a8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:58.035660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def0b3-78f9-4b1e-8b01-6dbca24e19a8 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:58.037114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 686/1391] 10.222.0.16 () {54 vars in 967 bytes} [Tue Aug 30 01:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:58.043493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:58.043493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:58.043755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:58.060367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:58.063438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68c41f-920f-4e98-9473-20437755d469 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:58.063738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68c41f-920f-4e98-9473-20437755d469 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:58.064052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68c41f-920f-4e98-9473-20437755d469 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:58.065596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 687/1392] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:06:58.070877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:58.071169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:58.071452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:58.124552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] MFA Rules not processed for user `7f1fb138bb984445a9187f782b47589c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:58.125694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:58.155967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:58.157319 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:58.226346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 706/1393] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 30 01:06:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:58.235709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:58.243663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4f81-a86b-4dd7-8d11-44a878139e73 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:58.271581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 688/1394] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:06:58.324220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:58.324842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:58.325245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:58.325744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:58.327177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:58.358866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:58.443387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:58.444736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54cb3a-9d4c-4eda-b7d1-34d17646e519 service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:58.466813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 707/1395] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:06:58.568854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:58.570595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:58.585657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:58.694478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692596-01fd-45a5-8ae7-e280aa344c67 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:06:58.822546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:06:58.823216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:58.823553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:58.824484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:58.826126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:58.835106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:58.928975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:06:58.930916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7814965-e86f-4096-aa30-685d05663246 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:06:58.950664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 689/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:06:59.450252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282962-66a1-4335-bc0f-0fc3e214c5a0 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:59.450808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282962-66a1-4335-bc0f-0fc3e214c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:59.451149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282962-66a1-4335-bc0f-0fc3e214c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:59.534933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e9282962-66a1-4335-bc0f-0fc3e214c5a0 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:59.536178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e9282962-66a1-4335-bc0f-0fc3e214c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:59.641003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:59.650292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 708/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:59.701928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746f48-66cd-4f1f-ad4f-60959e837489 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:59.702466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746f48-66cd-4f1f-ad4f-60959e837489 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:59.702466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746f48-66cd-4f1f-ad4f-60959e837489 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:59.703863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 690/1398] 10.222.0.16 () {54 vars in 943 bytes} [Tue Aug 30 01:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:06:59.710693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76efe-f1b8-4519-97c0-b4deeae8b6d9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:06:59.710989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76efe-f1b8-4519-97c0-b4deeae8b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:06:59.711306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76efe-f1b8-4519-97c0-b4deeae8b6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:06:59.787838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c6f76efe-f1b8-4519-97c0-b4deeae8b6d9 None None] MFA Rules not processed for user `4d48d9e6668b4866a21c2e0361fd3b88`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:06:59.789118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c6f76efe-f1b8-4519-97c0-b4deeae8b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:06:59.905653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 709/1399] 10.222.0.16 () {58 vars in 1040 bytes} [Tue Aug 30 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:06:59.914847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746f48-66cd-4f1f-ad4f-60959e837489 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:06:59.916471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a8746f48-66cd-4f1f-ad4f-60959e837489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:00.067615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:00.069200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746f48-66cd-4f1f-ad4f-60959e837489 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:00.177630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:00.178191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:00.178618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:00.178900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:00.180638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:00.266330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:00.268028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ae604-3f41-4891-b013-69fc92a752f9 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:00.276301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 691/1400] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:07:01.137381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a79f-d0b5-43b6-812e-9920be335b42 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:01.138147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a79f-d0b5-43b6-812e-9920be335b42 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:01.138147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a79f-d0b5-43b6-812e-9920be335b42 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:01.141171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 710/1401] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:07:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:01.144962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a68b-3029-462b-aa5f-44ca2b76594f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:01.145432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a68b-3029-462b-aa5f-44ca2b76594f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:01.145514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a68b-3029-462b-aa5f-44ca2b76594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:01.204688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:01.263404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-aca8a68b-3029-462b-aa5f-44ca2b76594f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:01.265453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-aca8a68b-3029-462b-aa5f-44ca2b76594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:01.408441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 692/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:01.702947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a79f-d0b5-43b6-812e-9920be335b42 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:01.704812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1562a79f-d0b5-43b6-812e-9920be335b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:01.774954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:01.919549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a79f-d0b5-43b6-812e-9920be335b42 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:02.022689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:02.023320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:02.023605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:02.023882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:02.025988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:02.112251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:02.140879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:02.140879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8b2e7-2bee-47c4-bd82-3110a92411f7 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:02.160440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 711/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:07:04.763741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8b7c-8680-4c02-90d8-270947ff3db4 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:04.764364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8b7c-8680-4c02-90d8-270947ff3db4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:04.764364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8b7c-8680-4c02-90d8-270947ff3db4 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:04.769906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 693/1404] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:07:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:04.774439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f683db-ac41-4651-bb3a-f3d39e5d0ec3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:04.774928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f683db-ac41-4651-bb3a-f3d39e5d0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:04.775032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f683db-ac41-4651-bb3a-f3d39e5d0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:04.857584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-83f683db-ac41-4651-bb3a-f3d39e5d0ec3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:04.859159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-83f683db-ac41-4651-bb3a-f3d39e5d0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:04.982512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:04.990266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 712/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:05.291689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8b7c-8680-4c02-90d8-270947ff3db4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:05.294296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-154e8b7c-8680-4c02-90d8-270947ff3db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:05.427819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:05.475001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8b7c-8680-4c02-90d8-270947ff3db4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:05.612967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:05.613616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:05.613990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:05.614317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:05.618200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:05.700531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:05.718980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:05.720577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a9fb-d312-4caf-b053-cd93ed883552 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:05.743323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 694/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:07.910263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c7d3-cd03-45d4-9f9a-977ab852c045 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:07.910863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c7d3-cd03-45d4-9f9a-977ab852c045 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:07.910863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c7d3-cd03-45d4-9f9a-977ab852c045 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:07.912436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 713/1407] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:07.917597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f17ac1-3773-4e5b-b930-026a01315ba6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:07.918251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f17ac1-3773-4e5b-b930-026a01315ba6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:07.918251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f17ac1-3773-4e5b-b930-026a01315ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:07.991617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-58f17ac1-3773-4e5b-b930-026a01315ba6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:07.992899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-58f17ac1-3773-4e5b-b930-026a01315ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:08.116311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 695/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:07:08.414460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7c7d3-cd03-45d4-9f9a-977ab852c045 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:08.416056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ceb7c7d3-cd03-45d4-9f9a-977ab852c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:08.614466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7c7d3-cd03-45d4-9f9a-977ab852c045 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:08.695195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:08.751289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:08.752025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:08.752381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:08.752746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:08.754526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:08.858094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:08.859776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1a185-8a10-4a10-ba54-44c6e7e9c458 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:08.879023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 714/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:18.113714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=78 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:18.876750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=65 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:24.805487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d73d-a81f-4ff0-8099-d1d351c90d25 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:24.806030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d73d-a81f-4ff0-8099-d1d351c90d25 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:24.806030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d73d-a81f-4ff0-8099-d1d351c90d25 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:24.807403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 696/1410] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 30 01:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:24.813523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05fd06-d324-4701-bfd3-50042d941700 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:24.813956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05fd06-d324-4701-bfd3-50042d941700 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:24.814112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05fd06-d324-4701-bfd3-50042d941700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:24.892832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ef05fd06-d324-4701-bfd3-50042d941700 None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:24.894139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ef05fd06-d324-4701-bfd3-50042d941700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:25.003427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 715/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 30 01:07:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:25.017627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac69d-d86e-4591-b389-2aee08fc4db8 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:25.017953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac69d-d86e-4591-b389-2aee08fc4db8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:25.018297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac69d-d86e-4591-b389-2aee08fc4db8 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:25.019675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 697/1412] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 30 01:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:25.025054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535875d4-6193-4073-9ca4-b695724d60c1 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:25.025054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535875d4-6193-4073-9ca4-b695724d60c1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:25.025337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535875d4-6193-4073-9ca4-b695724d60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:25.099593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:25.103864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-535875d4-6193-4073-9ca4-b695724d60c1 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:25.105369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-535875d4-6193-4073-9ca4-b695724d60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:25.226547 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 716/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 30 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:27.657393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2149a-5771-4653-81ae-71bed544635b None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:27.657925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2149a-5771-4653-81ae-71bed544635b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:27.657925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2149a-5771-4653-81ae-71bed544635b None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:27.659381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:27.664840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafd9d-3bca-4cc1-b02b-dbab8a49e5fd None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:27.665387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafd9d-3bca-4cc1-b02b-dbab8a49e5fd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:27.665493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafd9d-3bca-4cc1-b02b-dbab8a49e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:27.732240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a8aafd9d-3bca-4cc1-b02b-dbab8a49e5fd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:27.733493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a8aafd9d-3bca-4cc1-b02b-dbab8a49e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:27.791048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:27.834226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:28.127348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2149a-5771-4653-81ae-71bed544635b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:28.128887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0fc2149a-5771-4653-81ae-71bed544635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:28.281712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2149a-5771-4653-81ae-71bed544635b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:28.363941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:28.405067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:28.405682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:28.405963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:28.406240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:28.407845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:28.499212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:28.500846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f6ca-7971-434f-8a4e-4879da66fa6e service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:28.520021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 699/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:29.438206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a673a8-9211-4139-a6f5-53a14e7fd009 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:29.438778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a673a8-9211-4139-a6f5-53a14e7fd009 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:29.438778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a673a8-9211-4139-a6f5-53a14e7fd009 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:29.440120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:29.445194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0464-9562-4e92-ae4e-3fe65f9325bb None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:29.445645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0464-9562-4e92-ae4e-3fe65f9325bb None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:29.445754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d0464-9562-4e92-ae4e-3fe65f9325bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:29.529489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-1b5d0464-9562-4e92-ae4e-3fe65f9325bb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:29.530722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1b5d0464-9562-4e92-ae4e-3fe65f9325bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:29.560138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:29.632493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:29.783129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a673a8-9211-4139-a6f5-53a14e7fd009 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:29.784654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-58a673a8-9211-4139-a6f5-53a14e7fd009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:29.947588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a673a8-9211-4139-a6f5-53a14e7fd009 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:29.987580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:30.063495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:30.064013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:30.064294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:30.064568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:30.066309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:30.156703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:30.158345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f060ae-2b23-43fb-bf14-4c3bcac388d6 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:30.176083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 719/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:31.096768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6713ae6-702d-49ea-a84b-b2c68d760237 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:31.097334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6713ae6-702d-49ea-a84b-b2c68d760237 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:31.097334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6713ae6-702d-49ea-a84b-b2c68d760237 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:31.098637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:31.103682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c42b0-cd5b-4e9e-ac69-06264d18dc0e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:31.104115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c42b0-cd5b-4e9e-ac69-06264d18dc0e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:31.104799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c42b0-cd5b-4e9e-ac69-06264d18dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:31.162017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:31.185568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-298c42b0-cd5b-4e9e-ac69-06264d18dc0e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:31.186809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-298c42b0-cd5b-4e9e-ac69-06264d18dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:31.286077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:31.440039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6713ae6-702d-49ea-a84b-b2c68d760237 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:31.441509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b6713ae6-702d-49ea-a84b-b2c68d760237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:31.592860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6713ae6-702d-49ea-a84b-b2c68d760237 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:31.605532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:31.707691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:31.708240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:31.708521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:31.708796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:31.710438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:31.800866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:31.802511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fdb75-625d-42af-ac9a-5b24b7de2c4e service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:31.821149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 702/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:32.695021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367b0f-a10c-470f-95bb-6742ce058f12 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:32.695559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367b0f-a10c-470f-95bb-6742ce058f12 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:32.695559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6367b0f-a10c-470f-95bb-6742ce058f12 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:32.696978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:32.702831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9bd6-9f4e-4751-91a5-b5de14da772f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:32.703263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9bd6-9f4e-4751-91a5-b5de14da772f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:32.703358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9bd6-9f4e-4751-91a5-b5de14da772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:32.725268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:32.783151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4c8d9bd6-9f4e-4751-91a5-b5de14da772f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:32.784373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4c8d9bd6-9f4e-4751-91a5-b5de14da772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:32.881569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:33.039247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6367b0f-a10c-470f-95bb-6742ce058f12 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:33.040860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f6367b0f-a10c-470f-95bb-6742ce058f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:33.154052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:33.191116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6367b0f-a10c-470f-95bb-6742ce058f12 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:33.313240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:33.313771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:33.314056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:33.314332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:33.316001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:33.396235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:33.410594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:33.415396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d235a1-975b-4dec-8ab9-881b563112e8 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:33.430638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 722/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:34.317618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e613af5-b622-4f0e-b112-a39bcb261a81 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:34.318177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e613af5-b622-4f0e-b112-a39bcb261a81 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:34.318177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e613af5-b622-4f0e-b112-a39bcb261a81 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:34.319552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:34.325828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f730-2ed7-4107-9a13-cce71d49ec85 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:34.326231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f730-2ed7-4107-9a13-cce71d49ec85 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:34.326386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f730-2ed7-4107-9a13-cce71d49ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:34.402550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f9e6f730-2ed7-4107-9a13-cce71d49ec85 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:34.403836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f9e6f730-2ed7-4107-9a13-cce71d49ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:34.502727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:34.658014 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e613af5-b622-4f0e-b112-a39bcb261a81 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:34.659607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3e613af5-b622-4f0e-b112-a39bcb261a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:34.745032 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:34.808156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e613af5-b622-4f0e-b112-a39bcb261a81 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:34.923677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:34.924287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:34.924572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:34.924901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:34.926553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:34.976598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:35.019976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:35.021832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e38154-93f8-4c6c-8472-a4808de741b3 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:35.040847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 705/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:35.966034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f626-d409-4a92-889a-555e8660589d None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:35.966610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f626-d409-4a92-889a-555e8660589d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:35.966610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f626-d409-4a92-889a-555e8660589d None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:35.968025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:35.973064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbac7f-1d63-4c8a-9cf1-b8b9943aaf96 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:35.973472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbac7f-1d63-4c8a-9cf1-b8b9943aaf96 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:35.973620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbac7f-1d63-4c8a-9cf1-b8b9943aaf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:36.052306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-8ddbac7f-1d63-4c8a-9cf1-b8b9943aaf96 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:36.053573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8ddbac7f-1d63-4c8a-9cf1-b8b9943aaf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:36.156865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:36.314769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f626-d409-4a92-889a-555e8660589d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:36.316389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7996f626-d409-4a92-889a-555e8660589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:36.374641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:36.479587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f626-d409-4a92-889a-555e8660589d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:36.592692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:36.593356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:36.593643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:36.593924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:36.595543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:36.602424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:36.687766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:36.689463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da093a7d-633d-42d4-a094-24cdfe4bf8bf service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:36.713324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 725/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:37.592906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3481556-857d-4840-a693-23c328df1a2a None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:37.593488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3481556-857d-4840-a693-23c328df1a2a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:37.593488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3481556-857d-4840-a693-23c328df1a2a None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:37.594836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:37.600185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d73b0-e6a1-43d1-8126-0b11d184ce2f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:37.600636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d73b0-e6a1-43d1-8126-0b11d184ce2f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:37.600732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d73b0-e6a1-43d1-8126-0b11d184ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:37.677157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7c8d73b0-e6a1-43d1-8126-0b11d184ce2f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:37.678373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7c8d73b0-e6a1-43d1-8126-0b11d184ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:37.746715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:37.776757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:37.928115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3481556-857d-4840-a693-23c328df1a2a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:37.929671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c3481556-857d-4840-a693-23c328df1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:37.948923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:38.080955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3481556-857d-4840-a693-23c328df1a2a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:38.170873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:38.197564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:38.198846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:38.199131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:38.199451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:38.201807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:38.292709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:38.294949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4c99-77c5-41bb-b725-952761628136 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:38.316644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 708/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:39.189673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc732c3-2281-499f-b370-c04d86de0b3b None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:39.190264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc732c3-2281-499f-b370-c04d86de0b3b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:39.190264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc732c3-2281-499f-b370-c04d86de0b3b None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:39.191617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:39.196710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477398c3-a563-4a37-8e3b-4edaa94a8580 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:39.197407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477398c3-a563-4a37-8e3b-4edaa94a8580 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:39.197569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477398c3-a563-4a37-8e3b-4edaa94a8580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:39.275383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-477398c3-a563-4a37-8e3b-4edaa94a8580 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:39.278180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-477398c3-a563-4a37-8e3b-4edaa94a8580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:39.320880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:39.376271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:39.530241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc732c3-2281-499f-b370-c04d86de0b3b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:39.531789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dbc732c3-2281-499f-b370-c04d86de0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:39.678434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc732c3-2281-499f-b370-c04d86de0b3b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:39.733087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:39.794031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:39.794556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:39.794848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:39.795127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:39.796769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:39.886067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:39.887701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243eb94-b37c-445e-b1f1-f1aa044e4498 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:39.907372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 728/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:40.785432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de052a-27f8-447f-8d09-daa411c73e40 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:40.785952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de052a-27f8-447f-8d09-daa411c73e40 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:40.785952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de052a-27f8-447f-8d09-daa411c73e40 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:40.787261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:40.793438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6305ac-2ceb-48f5-a643-1ec35b1bf882 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:40.793965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6305ac-2ceb-48f5-a643-1ec35b1bf882 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:40.794125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6305ac-2ceb-48f5-a643-1ec35b1bf882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:40.871516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-dc6305ac-2ceb-48f5-a643-1ec35b1bf882 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:40.872765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dc6305ac-2ceb-48f5-a643-1ec35b1bf882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:40.875050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:40.972227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:41.128775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de052a-27f8-447f-8d09-daa411c73e40 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:41.130253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b0de052a-27f8-447f-8d09-daa411c73e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:41.278494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de052a-27f8-447f-8d09-daa411c73e40 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:41.305528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:41.394204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:41.394723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:41.395010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:41.395289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:41.396915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:41.487459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:41.489231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad7410-d239-4239-80db-b415dcac8a14 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:41.508878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 711/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:43.358842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe126e-8c83-4200-b6bc-d9c6c2d03cd1 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:43.359431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe126e-8c83-4200-b6bc-d9c6c2d03cd1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:43.359431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe126e-8c83-4200-b6bc-d9c6c2d03cd1 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:43.360759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:43.366033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9cf5-161e-4a8a-ae28-6d77104acfca None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:43.366468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9cf5-161e-4a8a-ae28-6d77104acfca None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:43.366573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9cf5-161e-4a8a-ae28-6d77104acfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:43.408037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:43.437873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f47b9cf5-161e-4a8a-ae28-6d77104acfca None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:43.444685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f47b9cf5-161e-4a8a-ae28-6d77104acfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:43.541838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:43.829546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe126e-8c83-4200-b6bc-d9c6c2d03cd1 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:43.831250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d5fe126e-8c83-4200-b6bc-d9c6c2d03cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:43.953205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe126e-8c83-4200-b6bc-d9c6c2d03cd1 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:43.992089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:44.037186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:44.037796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:44.038080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:44.038358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:44.040181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:44.160718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:44.162524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75799d2-d3a3-4b99-b040-c9108060168d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:44.186058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 731/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:46.374309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b11e1-3554-4b6c-8833-2f75ff0c0671 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:46.374933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b11e1-3554-4b6c-8833-2f75ff0c0671 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:46.374933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b11e1-3554-4b6c-8833-2f75ff0c0671 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:46.376213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:46.381575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603c033-48da-4f4a-a3ac-50fd40eac3f8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:46.382016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603c033-48da-4f4a-a3ac-50fd40eac3f8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:46.382146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603c033-48da-4f4a-a3ac-50fd40eac3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:46.452127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0603c033-48da-4f4a-a3ac-50fd40eac3f8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:46.453406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0603c033-48da-4f4a-a3ac-50fd40eac3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:46.467340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:46.554160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:46.844842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b11e1-3554-4b6c-8833-2f75ff0c0671 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:46.846423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c71b11e1-3554-4b6c-8833-2f75ff0c0671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:46.953875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b11e1-3554-4b6c-8833-2f75ff0c0671 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:46.968013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:47.032505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:47.033154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:47.033442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:47.033722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:47.035325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:47.148204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:47.149626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4cd30-cfad-4be5-90d9-e06db9c1a31d service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:47.169930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 714/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:49.554584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3a226-8df9-4dff-b0f6-33b85c4fe534 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:49.555119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3a226-8df9-4dff-b0f6-33b85c4fe534 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:49.555119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3a226-8df9-4dff-b0f6-33b85c4fe534 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:49.556483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:49.562505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aaffb-d6c0-474b-9cbe-3521ce08c554 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:49.562959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aaffb-d6c0-474b-9cbe-3521ce08c554 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:49.563113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aaffb-d6c0-474b-9cbe-3521ce08c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:49.612957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:49.631599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-db9aaffb-d6c0-474b-9cbe-3521ce08c554 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:49.632822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-db9aaffb-d6c0-474b-9cbe-3521ce08c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:49.733918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:07:50.015437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3a226-8df9-4dff-b0f6-33b85c4fe534 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:50.017052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cec3a226-8df9-4dff-b0f6-33b85c4fe534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:50.122034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3a226-8df9-4dff-b0f6-33b85c4fe534 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:50.162616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:50.196686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:50.197594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:50.197926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:50.198437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:50.200177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:50.309430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:50.310872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3b01-f5a2-4517-8768-e221f723da62 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:50.330596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 734/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:52.405796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fa0f4-13e5-4ac4-bd97-b90f231d75a4 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:52.406368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fa0f4-13e5-4ac4-bd97-b90f231d75a4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:52.406368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fa0f4-13e5-4ac4-bd97-b90f231d75a4 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:52.407718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:52.413086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629de6-36fa-442f-8724-2a7946b222ad None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:52.413477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629de6-36fa-442f-8724-2a7946b222ad None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:52.413645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629de6-36fa-442f-8724-2a7946b222ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:52.484458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-08629de6-36fa-442f-8724-2a7946b222ad None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:52.485731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-08629de6-36fa-442f-8724-2a7946b222ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:52.506689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:52.592861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:07:52.885126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fa0f4-13e5-4ac4-bd97-b90f231d75a4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:52.887271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-368fa0f4-13e5-4ac4-bd97-b90f231d75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:52.992190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fa0f4-13e5-4ac4-bd97-b90f231d75a4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:53.013036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:53.068438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:53.069083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:53.069370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:53.069650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:53.071308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:53.180208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:53.183054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4db7-8f97-472b-8c9b-5d860445df65 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:53.203481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 717/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:55.326336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c84-765a-4df4-9207-64b9b5a6680f None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:55.327057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c84-765a-4df4-9207-64b9b5a6680f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:55.327057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c84-765a-4df4-9207-64b9b5a6680f None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:55.328233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:55.333722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2532cae-ea37-4791-83cb-671d4b4a0706 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:55.334162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2532cae-ea37-4791-83cb-671d4b4a0706 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:55.334272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2532cae-ea37-4791-83cb-671d4b4a0706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:55.398181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:55.401775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e2532cae-ea37-4791-83cb-671d4b4a0706 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:55.403007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e2532cae-ea37-4791-83cb-671d4b4a0706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:55.501890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:55.795303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c84-765a-4df4-9207-64b9b5a6680f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:55.796878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-308a7c84-765a-4df4-9207-64b9b5a6680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:55.906690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c84-765a-4df4-9207-64b9b5a6680f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:55.957300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:55.983919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:55.984561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:55.984851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:55.985229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:55.986876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:56.098418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:56.099787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bb9d1-5649-4b92-b306-5ebc7012ef6d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:56.118347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 737/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:07:58.175540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b0fe2-d165-4ad3-adbf-8695bef6aa07 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:58.176043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b0fe2-d165-4ad3-adbf-8695bef6aa07 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:58.176043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b0fe2-d165-4ad3-adbf-8695bef6aa07 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:58.177467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:07:58.183171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b52b9-495e-4ba2-9dc1-110edf560f02 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:58.183635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b52b9-495e-4ba2-9dc1-110edf560f02 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:58.183728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b52b9-495e-4ba2-9dc1-110edf560f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:58.252081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-259b52b9-495e-4ba2-9dc1-110edf560f02 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:07:58.253326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-259b52b9-495e-4ba2-9dc1-110edf560f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:58.282791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:58.350947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:07:58.644753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b0fe2-d165-4ad3-adbf-8695bef6aa07 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:07:58.646358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e51b0fe2-d165-4ad3-adbf-8695bef6aa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:58.753604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b0fe2-d165-4ad3-adbf-8695bef6aa07 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:07:58.792657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:58.832393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:07:58.833033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:07:58.833321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:07:58.833599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:07:58.835310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:07:58.947487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:07:58.948963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ff31-ea6e-441b-9918-a518d3f290b5 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:07:58.966988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 720/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:00.960692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2c498-5cda-4ab4-a0d3-b953aa5b825e None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:00.961281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2c498-5cda-4ab4-a0d3-b953aa5b825e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:00.961281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2c498-5cda-4ab4-a0d3-b953aa5b825e None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:00.962680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:00.968764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ce3cf-c709-4b5c-84ab-8eb5068f2df0 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:00.969260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ce3cf-c709-4b5c-84ab-8eb5068f2df0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:00.969367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ce3cf-c709-4b5c-84ab-8eb5068f2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:01.037593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a52ce3cf-c709-4b5c-84ab-8eb5068f2df0 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:01.038921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a52ce3cf-c709-4b5c-84ab-8eb5068f2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:01.047858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:01.142635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:01.441314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2c498-5cda-4ab4-a0d3-b953aa5b825e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:01.442863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2ba2c498-5cda-4ab4-a0d3-b953aa5b825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:01.556657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2c498-5cda-4ab4-a0d3-b953aa5b825e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:01.621525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:01.641216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:01.641874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:01.642158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:01.642435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:01.644097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:01.757578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:01.759092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeaf80-b81f-477a-869e-74835a84f976 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:01.779011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 740/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:03.805462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84e25-787c-4ca3-8af5-40fc60a245b9 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:03.805994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84e25-787c-4ca3-8af5-40fc60a245b9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:03.805994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84e25-787c-4ca3-8af5-40fc60a245b9 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:03.807286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:03.812839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259f4c-007a-4ab2-aeff-d815310865b2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:03.813311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259f4c-007a-4ab2-aeff-d815310865b2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:03.813419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259f4c-007a-4ab2-aeff-d815310865b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:03.883237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f259f4c-007a-4ab2-aeff-d815310865b2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:03.884542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f259f4c-007a-4ab2-aeff-d815310865b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:03.927838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:03.996981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:04.280715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84e25-787c-4ca3-8af5-40fc60a245b9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:04.282304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c3d84e25-787c-4ca3-8af5-40fc60a245b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:04.387973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84e25-787c-4ca3-8af5-40fc60a245b9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:04.427151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:04.463027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:04.464208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:04.464491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:04.464768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:04.466546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:04.578540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:04.579965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861de10e-5485-40ab-ad4b-a570b12320c3 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:04.598555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 723/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:06.790683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e120f3-4b24-44ee-a89c-1fc330533621 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:06.791214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e120f3-4b24-44ee-a89c-1fc330533621 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:06.791214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e120f3-4b24-44ee-a89c-1fc330533621 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:06.792650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:06.798115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b54ca-3c4f-4347-8d9e-56956a4f0bbb None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:06.798575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b54ca-3c4f-4347-8d9e-56956a4f0bbb None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:06.798674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b54ca-3c4f-4347-8d9e-56956a4f0bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:06.870295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-099b54ca-3c4f-4347-8d9e-56956a4f0bbb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:06.871457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-099b54ca-3c4f-4347-8d9e-56956a4f0bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:06.892051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:06.973320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:07.259163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e120f3-4b24-44ee-a89c-1fc330533621 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:07.260783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e5e120f3-4b24-44ee-a89c-1fc330533621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:07.367480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e120f3-4b24-44ee-a89c-1fc330533621 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:07.440294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:07.447345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:07.448092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:07.456853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:07.456853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:07.456853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:07.561090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:07.562514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8852b-227c-4b47-8784-5080d1c690cb service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:07.580668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 743/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:09.560432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e1e53-8feb-4cf9-96cf-36cb5b7a65f0 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:09.561041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e1e53-8feb-4cf9-96cf-36cb5b7a65f0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:09.561041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e1e53-8feb-4cf9-96cf-36cb5b7a65f0 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:09.562375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:09.567897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eba09-02de-404d-bc09-00d3806da0f4 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:09.568373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eba09-02de-404d-bc09-00d3806da0f4 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:09.568468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eba09-02de-404d-bc09-00d3806da0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:09.635704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5a6eba09-02de-404d-bc09-00d3806da0f4 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:09.637037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5a6eba09-02de-404d-bc09-00d3806da0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:09.686894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:09.741284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:10.030232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e1e53-8feb-4cf9-96cf-36cb5b7a65f0 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:10.031785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4f8e1e53-8feb-4cf9-96cf-36cb5b7a65f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:10.142212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e1e53-8feb-4cf9-96cf-36cb5b7a65f0 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:10.189773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:10.216109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:10.216717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:10.217029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:10.217362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:10.219530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:10.329728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:10.331179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c15ea-d229-4ef2-a4df-caa348c5f743 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:10.350022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 726/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:19.739367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=22 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:20.347585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=66 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:30.284251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccff6-ca89-4387-b6bf-15216feccdda None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:30.284809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccff6-ca89-4387-b6bf-15216feccdda None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:30.284809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ccff6-ca89-4387-b6bf-15216feccdda None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:30.286272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 745/1471] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:30.291787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af5c90-ab21-4227-82b7-f0ca7a0807ca None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:30.292330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af5c90-ab21-4227-82b7-f0ca7a0807ca None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:30.292330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af5c90-ab21-4227-82b7-f0ca7a0807ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:30.358202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-05af5c90-ab21-4227-82b7-f0ca7a0807ca None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:30.359420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-05af5c90-ab21-4227-82b7-f0ca7a0807ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:30.465459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 727/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:08:30.766098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd319-70aa-41fd-b0bc-f894c5a5d95a None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:30.766387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd319-70aa-41fd-b0bc-f894c5a5d95a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:30.766670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd319-70aa-41fd-b0bc-f894c5a5d95a None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:30.768019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 746/1473] 10.222.0.16 () {54 vars in 967 bytes} [Tue Aug 30 01:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:30.772989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4420-009e-476a-b29e-198071dd2913 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:30.773283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4420-009e-476a-b29e-198071dd2913 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:30.773569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4420-009e-476a-b29e-198071dd2913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:30.852380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-fa9e4420-009e-476a-b29e-198071dd2913 None None] MFA Rules not processed for user `7f1fb138bb984445a9187f782b47589c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:30.853530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fa9e4420-009e-476a-b29e-198071dd2913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:30.875818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:30.933875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 728/1474] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 30 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:30.942932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fd319-70aa-41fd-b0bc-f894c5a5d95a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:30.944483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a30fd319-70aa-41fd-b0bc-f894c5a5d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:31.060176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fd319-70aa-41fd-b0bc-f894c5a5d95a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:31.144996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:31.145568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:31.145856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:31.146155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:31.147860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:31.208969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:31.264060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:31.271221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69fec1-af8d-4c5a-8504-367c88c3f52f service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:31.286110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 747/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:33.354953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21880b86-f999-4636-a7dc-ef1bc0287423 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:33.355553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21880b86-f999-4636-a7dc-ef1bc0287423 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:33.355553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21880b86-f999-4636-a7dc-ef1bc0287423 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:33.356871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 729/1476] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:33.362490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c2df7-04ef-4212-81dd-e7674b637b26 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:33.362950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c2df7-04ef-4212-81dd-e7674b637b26 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:33.363059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c2df7-04ef-4212-81dd-e7674b637b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:33.429250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-049c2df7-04ef-4212-81dd-e7674b637b26 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:33.430474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-049c2df7-04ef-4212-81dd-e7674b637b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:33.539101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 748/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:33.814930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21880b86-f999-4636-a7dc-ef1bc0287423 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:33.816500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-21880b86-f999-4636-a7dc-ef1bc0287423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:33.977629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21880b86-f999-4636-a7dc-ef1bc0287423 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:34.036652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:34.087127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:34.087664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:34.087994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:34.088341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:34.089300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:34.091071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:08:34.091071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:08:34.091071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:08:34.092237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb2d7b-0fab-42a6-baf4-373efd01baf6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:34.112455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 730/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 30 01:08:33 2022] GET /identity/v3/projects => generated 2553 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:08:36.061076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d65-0628-4e34-bb77-7bfa96e7ea0c None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:36.061633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d65-0628-4e34-bb77-7bfa96e7ea0c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:36.061742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd06d65-0628-4e34-bb77-7bfa96e7ea0c None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:36.063020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 749/1479] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:36.068408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b7054-080a-4688-b232-7f85326fba53 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:36.068814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b7054-080a-4688-b232-7f85326fba53 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:36.069040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b7054-080a-4688-b232-7f85326fba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:36.138459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ad7b7054-080a-4688-b232-7f85326fba53 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:36.139691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ad7b7054-080a-4688-b232-7f85326fba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:36.242233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 731/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:36.543944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd06d65-0628-4e34-bb77-7bfa96e7ea0c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:36.545554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bdd06d65-0628-4e34-bb77-7bfa96e7ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:36.555775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:36.814439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd06d65-0628-4e34-bb77-7bfa96e7ea0c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:36.894203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:36.928252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:36.928861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:36.929240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:36.929449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:36.931081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:37.020254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:37.021910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01639a44-fd95-44d8-bf35-c0c956bb00ca service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:37.043066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 750/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:39.154584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b660b-3c87-44e3-b900-8ab1bd056880 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:39.155093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b660b-3c87-44e3-b900-8ab1bd056880 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:39.155093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b660b-3c87-44e3-b900-8ab1bd056880 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:39.156415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 732/1482] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:39.161843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34672-07e9-4270-94cd-16be64606fef None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:39.162264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34672-07e9-4270-94cd-16be64606fef None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:39.162406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34672-07e9-4270-94cd-16be64606fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:39.233050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-aae34672-07e9-4270-94cd-16be64606fef None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:39.234279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-aae34672-07e9-4270-94cd-16be64606fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:39.280060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.328615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 751/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:39.615782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b660b-3c87-44e3-b900-8ab1bd056880 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:39.617385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b85b660b-3c87-44e3-b900-8ab1bd056880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:39.641912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.723425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b660b-3c87-44e3-b900-8ab1bd056880 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:39.797402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:39.797913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:39.798195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:39.798476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:39.800085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:39.878341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.913546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:39.914990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2490f-f00d-4b74-a427-6bbe7df553b4 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:39.934096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 733/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:41.913510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625f7a-8672-4e49-ac66-a3e57e087f31 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:41.914089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625f7a-8672-4e49-ac66-a3e57e087f31 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:41.914089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625f7a-8672-4e49-ac66-a3e57e087f31 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:41.915424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 752/1485] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:41.921526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3044f4-377b-4860-a1ea-cb4fc64baf34 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:41.921946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3044f4-377b-4860-a1ea-cb4fc64baf34 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:41.922130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3044f4-377b-4860-a1ea-cb4fc64baf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:41.989958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5e3044f4-377b-4860-a1ea-cb4fc64baf34 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:41.991187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5e3044f4-377b-4860-a1ea-cb4fc64baf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:42.090332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 734/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:42.401606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625f7a-8672-4e49-ac66-a3e57e087f31 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:42.403228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9f625f7a-8672-4e49-ac66-a3e57e087f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:42.515383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625f7a-8672-4e49-ac66-a3e57e087f31 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:42.591094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:42.592848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:42.593496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:42.593778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:42.594053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:42.595692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:42.709351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:42.710726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be9d98-93fc-45d7-8a25-0f27db78a2a2 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:42.729730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 753/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:44.827337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34dd7b-16a2-4974-825c-b5df1dfea97b None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:44.827867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34dd7b-16a2-4974-825c-b5df1dfea97b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:44.827867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34dd7b-16a2-4974-825c-b5df1dfea97b None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:44.829341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 735/1488] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:44.834621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ea73-2161-4b0f-bd39-750cb72ee617 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:44.835076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ea73-2161-4b0f-bd39-750cb72ee617 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:44.835173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ea73-2161-4b0f-bd39-750cb72ee617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:44.902601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9ba6ea73-2161-4b0f-bd39-750cb72ee617 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:44.903835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9ba6ea73-2161-4b0f-bd39-750cb72ee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:44.957717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:45.003118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 754/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:45.306662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34dd7b-16a2-4974-825c-b5df1dfea97b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:45.308255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2a34dd7b-16a2-4974-825c-b5df1dfea97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:45.345865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:45.418944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34dd7b-16a2-4974-825c-b5df1dfea97b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:45.493086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:45.493706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:45.493986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:45.494265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:45.496181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:45.582659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:45.614033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:45.615554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c2c7-9884-4b43-944b-4c825a3bba28 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:45.638976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 736/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:08:48.104763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c52a7-8272-47c8-840f-b657e787e341 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:48.105966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c52a7-8272-47c8-840f-b657e787e341 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:48.106211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c52a7-8272-47c8-840f-b657e787e341 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:48.107503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 755/1491] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 30 01:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:08:48.112805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093cda-b3b6-48bd-b2dd-80e784b673de None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:48.113298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093cda-b3b6-48bd-b2dd-80e784b673de None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:48.113401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093cda-b3b6-48bd-b2dd-80e784b673de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:48.181723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-96093cda-b3b6-48bd-b2dd-80e784b673de None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:08:48.182958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-96093cda-b3b6-48bd-b2dd-80e784b673de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:48.295326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 737/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 30 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:08:48.591335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c52a7-8272-47c8-840f-b657e787e341 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:08:48.592903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bd3c52a7-8272-47c8-840f-b657e787e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:48.708510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c52a7-8272-47c8-840f-b657e787e341 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:08:48.788338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:08:48.788985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:08:48.789253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:08:48.789526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:08:48.791138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:08:48.801089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:48.912277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:08:48.913796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a930b-2879-4504-bdfa-35772670f59e service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:08:48.935054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 756/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:08:58.293519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=82 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:58.931913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=50 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:12.810481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:12.811040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:12.811040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:12.890194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:12.891427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:12.987964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 738/1494] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:12.995783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:12.996272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:12.996366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.072727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:13.073881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.167562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 757/1495] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:13.172962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.174196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.186297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95f29f-caf1-4ace-abcc-52de5c927ba1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.246435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:13.279821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.280430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.280715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.281018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.281666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:10:13.281966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.282975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:13.282975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:10:13.282975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:10:13.283883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.295760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 739/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:10:13.303969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.313837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a246fb-b9be-4af9-aec6-0f75f0cc9ae4 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.374591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:13.407828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.408409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.408690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.408983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.409648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.411388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:13.411388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:10:13.411388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:10:13.412586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.555256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 758/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:10:13 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:13.559670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.561356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.595288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae59b-c715-4576-988c-ef41f9e48388 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.688177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.688713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.689023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.689304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.689941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.690949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:13.690949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:10:13.690949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:10:13.692171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.798594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 740/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:10:13 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:10:13.802777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.804302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.867298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8267eb5-ab30-4aec-83e1-22eb4171b0f0 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:13.952880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:13.963122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:13.963732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:13.964014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:13.964292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:13.964994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:13.966702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:13.966702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:10:13.966702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:10:13.967626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:13.980057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 759/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:13.984411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:13.986005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:13.997608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545606-0277-40e4-8445-7204ff34e8a9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:14.023730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:14.097516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:14.098135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.098419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.098699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.099345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:14.100386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:14.100386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:10:14.100386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:10:14.101322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bdb6c-b7db-4f13-b592-a407d50d9638 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:14.114616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 741/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:10:14.118901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:14.120430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.154745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898dbdd-72cb-41ef-aacf-ceea8788d5f9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:14.250616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:14.251285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.251566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.251841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] PATH_INFO: `/v3/projects/6252dce505744d0f8f86b033829458bc/users/5b60790403b34e64b878eecd86375283/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.274361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6252dce505744d0f8f86b033829458bc, user_id=5b60790403b34e64b878eecd86375283, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:14.275396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:14.275396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:10:14.275396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:10:14.277380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797565b3-b094-4716-b78b-44ea796f6938 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:14.372589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 760/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:10:14 2022] PUT /identity/v3/projects/6252dce505744d0f8f86b033829458bc/users/5b60790403b34e64b878eecd86375283/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:14.385157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea897-656e-4dd6-8e56-cca238db4828 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.385470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea897-656e-4dd6-8e56-cca238db4828 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.385747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea897-656e-4dd6-8e56-cca238db4828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.443992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-67fea897-656e-4dd6-8e56-cca238db4828 None None] MFA Rules not processed for user `5b60790403b34e64b878eecd86375283`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:14.445262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-67fea897-656e-4dd6-8e56-cca238db4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.523044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 742/1502] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:14.536656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc74a2-cfe6-421a-82d4-684563541d3f None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.536968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc74a2-cfe6-421a-82d4-684563541d3f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.537272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc74a2-cfe6-421a-82d4-684563541d3f None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.538615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 761/1503] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 30 01:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:10:14.543377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e85b1-986e-4fdd-8900-573a40f8c75a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.544218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e85b1-986e-4fdd-8900-573a40f8c75a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.545028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e85b1-986e-4fdd-8900-573a40f8c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.577628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:14.623440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-688e85b1-986e-4fdd-8900-573a40f8c75a None None] MFA Rules not processed for user `37d12b58ffac40e8a90d32748f470a61`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:14.624648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-688e85b1-986e-4fdd-8900-573a40f8c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.701370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 743/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Aug 30 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:14.709320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc74a2-cfe6-421a-82d4-684563541d3f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:14.710844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-92cc74a2-cfe6-421a-82d4-684563541d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.760346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:14.812295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc74a2-cfe6-421a-82d4-684563541d3f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:14.891688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:14.892296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:14.892581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:14.892859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:14.894545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:14.993826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:14.995269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:14.999498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:15.014305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 762/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:10:15.060370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56d85-5a31-412a-8b69-02217ba91366 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.060834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56d85-5a31-412a-8b69-02217ba91366 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.061029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56d85-5a31-412a-8b69-02217ba91366 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.062282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 744/1506] 10.222.0.16 () {52 vars in 830 bytes} [Tue Aug 30 01:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:10:15.065959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.067129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.171569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497de935-3e26-4490-ab59-a8b9c6e14cb9 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.266495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425954-7777-4125-825c-6727512daee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.267126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425954-7777-4125-825c-6727512daee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.267408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425954-7777-4125-825c-6727512daee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.267684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38425954-7777-4125-825c-6727512daee3 admin admin] PATH_INFO: `/v3/users/5b60790403b34e64b878eecd86375283` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.280338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425954-7777-4125-825c-6727512daee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b60790403b34e64b878eecd86375283)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:15.281404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-38425954-7777-4125-825c-6727512daee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:15.281404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:10:15.281404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:10:15.282626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38425954-7777-4125-825c-6727512daee3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:15.292022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:15.450939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b60790403b34e64b878eecd86375283'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.451375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b60790403b34e64b878eecd86375283'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.471067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b60790403b34e64b878eecd86375283'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.525956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b60790403b34e64b878eecd86375283'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.551583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b60790403b34e64b878eecd86375283'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:15.557351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 763/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:10:15 2022] DELETE /identity/v3/users/5b60790403b34e64b878eecd86375283 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:15.562199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.562494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.562786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.627548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:10:15.628783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.711883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:15.724594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 745/1508] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:10:15.735202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:15.736492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:15.842990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38425954-7777-4125-825c-6727512daee3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:15.900028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:15.920796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:15.921444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:15.921724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:15.921999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:15.923623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.061727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:16.064592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c51c3-ecd3-4f7a-8d9f-10db3e5d5ee6 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.093495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 764/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:10:16.545030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:10:16.545527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:10:16.557305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166aad-5691-42de-bd9c-3a2adf41154e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:10:16.656459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:10:16.657147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:10:16.657507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:10:16.657688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] PATH_INFO: `/v3/projects/6252dce505744d0f8f86b033829458bc` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:10:16.667583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6252dce505744d0f8f86b033829458bc)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:10:16.669343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:10:16.669343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:10:16.669343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:10:16.670567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:10:16.789381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6252dce505744d0f8f86b033829458bc', 'request_id': 'req-9d05afca-86ea-4848-bded-92047111f524'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.802622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6252dce505744d0f8f86b033829458bc', 'request_id': 'req-9d05afca-86ea-4848-bded-92047111f524'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.808681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6252dce505744d0f8f86b033829458bc', 'request_id': 'req-9d05afca-86ea-4848-bded-92047111f524'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.924103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] The token cache is being invalidate because project 6252dce505744d0f8f86b033829458bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:10:16.924428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.924864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9d05afca-86ea-4848-bded-92047111f524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:10:16.926368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 746/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:10:16 2022] DELETE /identity/v3/projects/6252dce505744d0f8f86b033829458bc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:10:26.091222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=62 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:26.921995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:57.193255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df686006-73ff-4e4b-94dd-2782e2b94ed1 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.193872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df686006-73ff-4e4b-94dd-2782e2b94ed1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.193872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df686006-73ff-4e4b-94dd-2782e2b94ed1 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.195160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:57.200537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516992d-fe25-4dd7-9f21-cacd9a4f0286 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.201148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516992d-fe25-4dd7-9f21-cacd9a4f0286 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.201148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516992d-fe25-4dd7-9f21-cacd9a4f0286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.282820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7516992d-fe25-4dd7-9f21-cacd9a4f0286 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:57.284040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7516992d-fe25-4dd7-9f21-cacd9a4f0286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.391941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:57.554190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df686006-73ff-4e4b-94dd-2782e2b94ed1 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:57.556290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-df686006-73ff-4e4b-94dd-2782e2b94ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:57.676971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df686006-73ff-4e4b-94dd-2782e2b94ed1 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:57.682488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4270f2-e3e6-4232-9296-1bc693612b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:57.683096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4270f2-e3e6-4232-9296-1bc693612b3d service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:57.683382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4270f2-e3e6-4232-9296-1bc693612b3d service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:57.683660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4270f2-e3e6-4232-9296-1bc693612b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:57.691956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4270f2-e3e6-4232-9296-1bc693612b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:57.694122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4270f2-e3e6-4232-9296-1bc693612b3d service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:57.703776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 766/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:58.560398 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331327-b568-4647-ba4f-5486c264bcb2 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.560924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331327-b568-4647-ba4f-5486c264bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.561071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331327-b568-4647-ba4f-5486c264bcb2 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.562352 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:11:58.567714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6bad-62ab-4967-81f6-20fcfa96c0f1 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.568295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6bad-62ab-4967-81f6-20fcfa96c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.568295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6bad-62ab-4967-81f6-20fcfa96c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.588198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e83c6bad-62ab-4967-81f6-20fcfa96c0f1 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:58.589440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e83c6bad-62ab-4967-81f6-20fcfa96c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:11:58.597243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:11:58.750047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331327-b568-4647-ba4f-5486c264bcb2 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:11:58.765545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331327-b568-4647-ba4f-5486c264bcb2 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:11:58.772090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6944e-3503-4237-8dc9-3b1172df644c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:11:58.772644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6944e-3503-4237-8dc9-3b1172df644c service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:58.772930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6944e-3503-4237-8dc9-3b1172df644c service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:58.773246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6944e-3503-4237-8dc9-3b1172df644c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:58.782227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6944e-3503-4237-8dc9-3b1172df644c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:11:58.783840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6944e-3503-4237-8dc9-3b1172df644c service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:11:58.794937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 749/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:11:59.923452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e983-f8ef-432f-8cc9-6ab4001e6afc None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:59.924021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e983-f8ef-432f-8cc9-6ab4001e6afc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:59.924021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e983-f8ef-432f-8cc9-6ab4001e6afc None None] PATH_INFO: `/v3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:59.925401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 768/1517] 10.222.0.84 () {54 vars in 925 bytes} [Tue Aug 30 01:11:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:11:59.932634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25829393-47ea-4f6b-baad-5c92736c3dd6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:11:59.933096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25829393-47ea-4f6b-baad-5c92736c3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:11:59.933215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25829393-47ea-4f6b-baad-5c92736c3dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:11:59.994124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-25829393-47ea-4f6b-baad-5c92736c3dd6 None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:11:59.995342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-25829393-47ea-4f6b-baad-5c92736c3dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:00.013006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:00.069228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 750/1518] 10.222.0.84 () {58 vars in 1015 bytes} [Tue Aug 30 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:04.324980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70f81-1c33-4317-8fd9-c9a30f332af3 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.325812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70f81-1c33-4317-8fd9-c9a30f332af3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.325985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70f81-1c33-4317-8fd9-c9a30f332af3 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.327475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 769/1519] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 30 01:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:04.333286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed965-d11d-49d1-8214-1311a6521cdf None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.333989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed965-d11d-49d1-8214-1311a6521cdf None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.333989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed965-d11d-49d1-8214-1311a6521cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.355864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-de4ed965-d11d-49d1-8214-1311a6521cdf None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:04.357140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-de4ed965-d11d-49d1-8214-1311a6521cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:04.366123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 751/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 30 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:04.374013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be70f81-1c33-4317-8fd9-c9a30f332af3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:04.388332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be70f81-1c33-4317-8fd9-c9a30f332af3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:04.393312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5031c-52cc-4de0-97f7-c8ef7f0649fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:04.393907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5031c-52cc-4de0-97f7-c8ef7f0649fd service placement] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:04.394191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5031c-52cc-4de0-97f7-c8ef7f0649fd service placement] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:04.394468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5031c-52cc-4de0-97f7-c8ef7f0649fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:04.404451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5031c-52cc-4de0-97f7-c8ef7f0649fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:04.406080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5031c-52cc-4de0-97f7-c8ef7f0649fd service placement] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:04.416538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 770/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:10.083914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f553-a677-4e4d-8516-8c99d87ee7de None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:10.084511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f553-a677-4e4d-8516-8c99d87ee7de None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:10.084511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f553-a677-4e4d-8516-8c99d87ee7de None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:10.085861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:10.092420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ba6a-f015-487c-8881-678e8c9fcef6 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:10.093441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ba6a-f015-487c-8881-678e8c9fcef6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:10.093441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281ba6a-f015-487c-8881-678e8c9fcef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:10.113729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2281ba6a-f015-487c-8881-678e8c9fcef6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:10.115696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2281ba6a-f015-487c-8881-678e8c9fcef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:10.126288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:10.312101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f553-a677-4e4d-8516-8c99d87ee7de None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:10.328187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f553-a677-4e4d-8516-8c99d87ee7de None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:10.334798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863cd50-c916-4afb-802d-e153a4d2f55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:10.335418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863cd50-c916-4afb-802d-e153a4d2f55a service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:10.335717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863cd50-c916-4afb-802d-e153a4d2f55a service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:10.337262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863cd50-c916-4afb-802d-e153a4d2f55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:10.348316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863cd50-c916-4afb-802d-e153a4d2f55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:10.351108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863cd50-c916-4afb-802d-e153a4d2f55a service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:10.361738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 753/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:11.327945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78035a-07db-4414-b273-4bfbbc579840 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:11.328595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78035a-07db-4414-b273-4bfbbc579840 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:11.328595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78035a-07db-4414-b273-4bfbbc579840 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:11.329914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:11.335309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e98b-596e-45a8-96e7-7ad0da269b2d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:11.335762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e98b-596e-45a8-96e7-7ad0da269b2d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:11.335865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6e98b-596e-45a8-96e7-7ad0da269b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:11.356064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e1e6e98b-596e-45a8-96e7-7ad0da269b2d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:11.357312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e1e6e98b-596e-45a8-96e7-7ad0da269b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:11.365672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:11.519743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78035a-07db-4414-b273-4bfbbc579840 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:11.535381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78035a-07db-4414-b273-4bfbbc579840 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:11.541550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3bca2-de41-49e5-b5f2-26c68aeaa54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:11.542127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3bca2-de41-49e5-b5f2-26c68aeaa54a service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:11.542407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3bca2-de41-49e5-b5f2-26c68aeaa54a service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:11.542683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3bca2-de41-49e5-b5f2-26c68aeaa54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:11.550700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3bca2-de41-49e5-b5f2-26c68aeaa54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:11.552357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3bca2-de41-49e5-b5f2-26c68aeaa54a service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:11.570102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 773/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:15.716433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab752c-33a8-454f-a64c-d02ecf538d74 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.717013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab752c-33a8-454f-a64c-d02ecf538d74 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.717122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab752c-33a8-454f-a64c-d02ecf538d74 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.718455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:15.723690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f5c30-a64a-414e-b3f9-a2f38a2ee4fc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:15.724111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f5c30-a64a-414e-b3f9-a2f38a2ee4fc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:15.724468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f5c30-a64a-414e-b3f9-a2f38a2ee4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:15.744645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-681f5c30-a64a-414e-b3f9-a2f38a2ee4fc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:15.745894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-681f5c30-a64a-414e-b3f9-a2f38a2ee4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:15.753780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:16.040068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab752c-33a8-454f-a64c-d02ecf538d74 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:16.041872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-86ab752c-33a8-454f-a64c-d02ecf538d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:16.131727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab752c-33a8-454f-a64c-d02ecf538d74 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:16.135405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161326e9-f58c-4f22-acce-4f7b01ebc6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:16.136028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161326e9-f58c-4f22-acce-4f7b01ebc6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:16.136315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161326e9-f58c-4f22-acce-4f7b01ebc6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:16.136596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161326e9-f58c-4f22-acce-4f7b01ebc6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:16.146748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161326e9-f58c-4f22-acce-4f7b01ebc6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:16.148197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161326e9-f58c-4f22-acce-4f7b01ebc6e6 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:16.158069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 756/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:18.098624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8657de2-5df0-4a7f-860d-83791f8e962d None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:18.100073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8657de2-5df0-4a7f-860d-83791f8e962d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:18.100367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8657de2-5df0-4a7f-860d-83791f8e962d None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:18.101873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:18.107601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d39b-c39f-42fb-80ea-bbdb88e5ad00 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:18.108038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d39b-c39f-42fb-80ea-bbdb88e5ad00 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:18.108152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d39b-c39f-42fb-80ea-bbdb88e5ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:18.127988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9cd0d39b-c39f-42fb-80ea-bbdb88e5ad00 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:18.129231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9cd0d39b-c39f-42fb-80ea-bbdb88e5ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:18.137842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:18.427787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8657de2-5df0-4a7f-860d-83791f8e962d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:18.429637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e8657de2-5df0-4a7f-860d-83791f8e962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:18.444728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8657de2-5df0-4a7f-860d-83791f8e962d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:18.449042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdfb29-a4a8-4374-bb9d-d833d8d4ff52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:18.449660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdfb29-a4a8-4374-bb9d-d833d8d4ff52 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:18.449941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdfb29-a4a8-4374-bb9d-d833d8d4ff52 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:18.451117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdfb29-a4a8-4374-bb9d-d833d8d4ff52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:18.461395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdfb29-a4a8-4374-bb9d-d833d8d4ff52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:18.462820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdfb29-a4a8-4374-bb9d-d833d8d4ff52 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:18.473365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 776/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:22.244969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334041e-dbd4-45e5-9006-98563a24bda5 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.245561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334041e-dbd4-45e5-9006-98563a24bda5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.245561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334041e-dbd4-45e5-9006-98563a24bda5 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.246906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:22.252391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2346-2ab3-4f2d-a967-dad1a7c67559 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.255470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2346-2ab3-4f2d-a967-dad1a7c67559 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.255470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2346-2ab3-4f2d-a967-dad1a7c67559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.272561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-eacb2346-2ab3-4f2d-a967-dad1a7c67559 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:22.273818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-eacb2346-2ab3-4f2d-a967-dad1a7c67559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:22.281810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:22.855091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334041e-dbd4-45e5-9006-98563a24bda5 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:22.856823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2334041e-dbd4-45e5-9006-98563a24bda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:22.923456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:22.937142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334041e-dbd4-45e5-9006-98563a24bda5 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:22.940788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788be2a-4ba2-40eb-aa48-ee0e6085910f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:22.941436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788be2a-4ba2-40eb-aa48-ee0e6085910f service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:22.941724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788be2a-4ba2-40eb-aa48-ee0e6085910f service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:22.942006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788be2a-4ba2-40eb-aa48-ee0e6085910f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:22.951584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788be2a-4ba2-40eb-aa48-ee0e6085910f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:22.953045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788be2a-4ba2-40eb-aa48-ee0e6085910f service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:22.963147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 759/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:24.955646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d86cc1-c496-4365-81ad-83d02980b920 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.956195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d86cc1-c496-4365-81ad-83d02980b920 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.956195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d86cc1-c496-4365-81ad-83d02980b920 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.957495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:12:24.963396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9484e-c7ae-49a7-b8c8-33ab03ffb2c3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:24.963847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9484e-c7ae-49a7-b8c8-33ab03ffb2c3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:24.963955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9484e-c7ae-49a7-b8c8-33ab03ffb2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:24.985365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a4e9484e-c7ae-49a7-b8c8-33ab03ffb2c3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:12:24.986581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a4e9484e-c7ae-49a7-b8c8-33ab03ffb2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:24.994844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:12:25.561284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d86cc1-c496-4365-81ad-83d02980b920 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:12:25.563019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d5d86cc1-c496-4365-81ad-83d02980b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:12:25.577021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d86cc1-c496-4365-81ad-83d02980b920 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:12:25.580551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8d15b-16b9-4ee2-bc67-fa3464c6742a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:12:25.581185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d15b-16b9-4ee2-bc67-fa3464c6742a service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:12:25.581474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d15b-16b9-4ee2-bc67-fa3464c6742a service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:12:25.581756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d15b-16b9-4ee2-bc67-fa3464c6742a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:12:25.590774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8d15b-16b9-4ee2-bc67-fa3464c6742a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:12:25.592208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8d15b-16b9-4ee2-bc67-fa3464c6742a service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:12:25.601572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 779/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:12:34.980475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=11 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:35.597408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:57.254672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.290218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.290218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.290218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:57.291249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.299896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 761/1540] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.309345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.310731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.310731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.345570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:57.347150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:57.356355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 780/1541] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:57.361748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.378484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf08e-e008-493c-be44-6fc5e3c51831 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.389071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.389940 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.390406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.390867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.391698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:57.392172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.394062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.411734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 762/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:57.420439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.430893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f65f7-bb4c-4779-9cbe-2af80ef8f1f9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.447399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.448409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.448925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.449472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.450359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.452507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.565634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 781/1543] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:57.571840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.584139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c777-2548-4c8d-a644-c9a4743a002b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.655749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.656370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.656652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.656995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.657652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.660138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.759281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 763/1544] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:57 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:57.763889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.777148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231fa03-4587-476d-bb9b-28c86e7e349b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.786588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.787588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.788728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.789259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.790157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.792073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.803710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 782/1545] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:57.807783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.823767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901124-9ff4-4811-b544-f2a70fc1a967 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.832766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687011-fbe2-4a2b-892f-393c52fac749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.833437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687011-fbe2-4a2b-892f-393c52fac749 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.833726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687011-fbe2-4a2b-892f-393c52fac749 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.834005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687011-fbe2-4a2b-892f-393c52fac749 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.834682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687011-fbe2-4a2b-892f-393c52fac749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.836970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687011-fbe2-4a2b-892f-393c52fac749 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:57.856848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 764/1546] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:57.861723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:57.876349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb26f0-1e41-4c6d-95b2-ca5621de2857 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:57.885905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548808-54f3-4fb8-96fc-8b8968b1627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:57.887011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548808-54f3-4fb8-96fc-8b8968b1627f admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:57.887517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548808-54f3-4fb8-96fc-8b8968b1627f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:57.888020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548808-54f3-4fb8-96fc-8b8968b1627f admin admin] PATH_INFO: `/v3/projects/038604204df04c48a3176646016677ac/users/e785778ee1764ea9ade06b8c7515d0ae/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:57.922608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548808-54f3-4fb8-96fc-8b8968b1627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=038604204df04c48a3176646016677ac, user_id=e785778ee1764ea9ade06b8c7515d0ae, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:57.925805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548808-54f3-4fb8-96fc-8b8968b1627f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.034786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 783/1547] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:13:57 2022] PUT /identity/v3/projects/038604204df04c48a3176646016677ac/users/e785778ee1764ea9ade06b8c7515d0ae/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:13:58.045682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.046019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.046519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.078518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.079941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.111490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b3a98-95e8-4528-a8d1-22d261266218 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.112098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b3a98-95e8-4528-a8d1-22d261266218 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.112673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b3a98-95e8-4528-a8d1-22d261266218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.143193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-893b3a98-95e8-4528-a8d1-22d261266218 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.144797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-893b3a98-95e8-4528-a8d1-22d261266218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.213066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 765/1548] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.228784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.289209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 784/1549] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.298806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.299435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.299930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.328039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.330153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.348232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4981bc-abf5-40e8-8750-876007e962b7 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.350435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 785/1550] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.355793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.356095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759c643-f8e2-4609-8c58-bc73879566d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.356743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759c643-f8e2-4609-8c58-bc73879566d3 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.357058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759c643-f8e2-4609-8c58-bc73879566d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.357610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759c643-f8e2-4609-8c58-bc73879566d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.367001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a81f3-169f-43fd-bd24-f2494f29dc16 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.375688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.375916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759c643-f8e2-4609-8c58-bc73879566d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.376802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.377207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759c643-f8e2-4609-8c58-bc73879566d3 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.377561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.378052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.378937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:58.379462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.380700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:58.380700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:13:58.380700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:13:58.382237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d27ba8-3be8-4c09-b6a3-17840f502518 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.395866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 786/1551] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:58.398874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.400257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.400770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.401989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 766/1552] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:13:58.403280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ad78a-4c8b-4f1a-9e05-6222008e7dd2 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.403573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ad78a-4c8b-4f1a-9e05-6222008e7dd2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.403858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ad78a-4c8b-4f1a-9e05-6222008e7dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.421413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:58.431728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-780ad78a-4c8b-4f1a-9e05-6222008e7dd2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.433297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-780ad78a-4c8b-4f1a-9e05-6222008e7dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.440033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.441790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.443072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 767/1553] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.452762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d504d-accf-44a7-b416-c22a0754253f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.452762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d504d-accf-44a7-b416-c22a0754253f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.452762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d504d-accf-44a7-b416-c22a0754253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.455716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 787/1554] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.456414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.473011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-950d504d-accf-44a7-b416-c22a0754253f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.474222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-950d504d-accf-44a7-b416-c22a0754253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.476289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17dabc-39a7-4bf9-aaca-6c72adf0494c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.481758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41456640-3931-4bba-a21d-7ca190c9c993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.482376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456640-3931-4bba-a21d-7ca190c9c993 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.482664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456640-3931-4bba-a21d-7ca190c9c993 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.482945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41456640-3931-4bba-a21d-7ca190c9c993 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.483770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41456640-3931-4bba-a21d-7ca190c9c993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.483889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 768/1555] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.484989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998918-5e64-42bf-8b98-b838f1371dbf None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.485260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998918-5e64-42bf-8b98-b838f1371dbf None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.485534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6998918-5e64-42bf-8b98-b838f1371dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.490956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41456640-3931-4bba-a21d-7ca190c9c993 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.513728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d6998918-5e64-42bf-8b98-b838f1371dbf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.515096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d6998918-5e64-42bf-8b98-b838f1371dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.527883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 769/1556] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.529421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d17697-2603-464b-a8fd-a47506d41da1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.529710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d17697-2603-464b-a8fd-a47506d41da1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.529999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d17697-2603-464b-a8fd-a47506d41da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.554323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e5d17697-2603-464b-a8fd-a47506d41da1 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.554323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e5d17697-2603-464b-a8fd-a47506d41da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.560599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 770/1557] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.561923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6280-758e-481b-9c9e-00328d21a33f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.562243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6280-758e-481b-9c9e-00328d21a33f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.562524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6280-758e-481b-9c9e-00328d21a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.582977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-943a6280-758e-481b-9c9e-00328d21a33f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.584170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-943a6280-758e-481b-9c9e-00328d21a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.592913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 771/1558] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.594430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80bb4e-f246-4584-909d-122689de8401 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.594770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80bb4e-f246-4584-909d-122689de8401 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.595179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80bb4e-f246-4584-909d-122689de8401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.616776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2e80bb4e-f246-4584-909d-122689de8401 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.617871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 788/1559] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:58.618491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2e80bb4e-f246-4584-909d-122689de8401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.619201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d79a4-bd21-4f8e-b413-24b57d2a21ed None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.619501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d79a4-bd21-4f8e-b413-24b57d2a21ed None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.619782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d79a4-bd21-4f8e-b413-24b57d2a21ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.640267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e29d79a4-bd21-4f8e-b413-24b57d2a21ed None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.645150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e29d79a4-bd21-4f8e-b413-24b57d2a21ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.677684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:58.682611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 772/1560] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.683880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd067d2-59ed-46a3-a755-5a99de1ffa96 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.684174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd067d2-59ed-46a3-a755-5a99de1ffa96 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.684672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd067d2-59ed-46a3-a755-5a99de1ffa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.705726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-efd067d2-59ed-46a3-a755-5a99de1ffa96 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.706402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 789/1561] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.706937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-efd067d2-59ed-46a3-a755-5a99de1ffa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.707666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.708080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.708363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.718597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 773/1562] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.719842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.720130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.720405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.732357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.733605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.742754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 790/1563] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.743741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.746392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.747619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.754147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c5b29-2e0a-45b5-b860-c1fcdf1c68d2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.760195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.760792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.761349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.761517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.762244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:58.762551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.764532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.769992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 774/1564] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.776869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.782664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 791/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:58.790746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.793711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d07c-3ebe-4e3c-8244-eed51fce1bb8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.801712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.801974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130b57-3d1e-4419-b543-d229ca227c67 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.802345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.802633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.802915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.803632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.811535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.811535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.811535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.811535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.812246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:58.812246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.812664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.812766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.830100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 792/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:58.831032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.842261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f83f6-3ba0-4eaa-999d-be7b0ecfc00b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.847384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.848001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.848289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.848576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.849270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:58.849578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.852120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613ebe-771a-4d9c-9877-b3d29000dbd3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.863573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 793/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:58.864793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.865351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.865488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.887765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:13:58.889020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:13:58.896896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 794/1568] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:13:58.898907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.908674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085a6d-e658-421f-b8b3-685316533c4e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.909295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 775/1569] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:58.910205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.914268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.914978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.915345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.915697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.916424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:58.916808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.918526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.920675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3f9f7-56a2-4c40-971b-99b5f966194e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.925425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.926027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.926306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.926582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.927315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:58.927620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.929241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.932201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 795/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:58.933156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.950790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 776/1571] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:58.951005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c4a3-3090-4892-b291-ae3e97e8b032 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.951109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:58.951220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.951220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.951220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.951220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.951571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.953556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:58.956887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e762d8-9b8c-4d5b-bbd6-84702361d8d0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:58.962610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:58.963226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:58.963647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:58.963933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:58.964626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:58.965692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:58.965692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:13:58.965692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:13:58.967489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.057483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 796/1572] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.058392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.088510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 777/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:58 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.088510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.139677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df22f-6f26-4779-9158-82f3c9462158 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.163160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a16ae0-b26a-491e-8f21-91a77e28e0a9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.168309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.169090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.169480 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.169979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.170710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:13:59.171134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.172974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.181664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:59.197279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 778/1574] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:13:59.197279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.202141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724402fc-3f90-4e16-9c47-3e753fd15aac admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.207904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.208822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.209273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.209638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.211133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.213456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.222689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.229353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.229353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.229353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.229353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.229721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 779/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:59.229721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.229906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.233169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:59.237570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e928ed-7227-4440-b75b-34a09e5e88e2 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.243099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.243718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.244055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.244336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.245003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.247172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.340586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 780/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.340586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.341487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 797/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.342355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.407937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942657e-effe-4efe-9b64-83d9ca779710 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.408252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5048850-dbd1-4cf3-b161-42002244eddb admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.413091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.413244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.413712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.413856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.414091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.414196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.414919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.415127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.415669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.415845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.416694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:13:59.416694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:13:59.416694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:13:59.417755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.417933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.535535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 798/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.537663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.537787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 781/1579] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.538440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.548275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784e5fa-7e91-49f2-a299-4722ac35eb4b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.605868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94a4aa-5433-4927-9ef0-9c6372b4e1db admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.609715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.610436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.610794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.611143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.611245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.611890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.611998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.612212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.612526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.613337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.613889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.615244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.735200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 799/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.736081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.746373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fda06-5f9d-4811-80fa-016b31f93976 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.751012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.751599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.751887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.752164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.752802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.754471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.765729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 800/1581] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:59.766521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.776977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceed66-626a-43cf-aecd-f0e3d872318c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.781733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.782356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.782637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.782918 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.783563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.785558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.800692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 782/1582] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/projects => generated 403 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.800692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.841016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:59.863312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70b10-f6f2-4a70-b02e-75cca9cfdbb3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.868663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.869312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.869602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.869910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.870627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.872570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.904890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 801/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.904890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.904890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113efd-3c8d-466f-9285-4ed4af4d9fff admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.904890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.906267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.906267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.906267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.906512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.907929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.918223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 802/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:13:59.919029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.928597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a557510-f97c-40b7-a796-72c19cdf43bb admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:13:59.934449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:13:59.935027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:13:59.935311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:13:59.935590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:13:59.936362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:13:59.938186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:13:59.990012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 783/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:13:59.990012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:13:59.998279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b746ee-16eb-4df6-a8fd-4a3a4f3fe746 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.003147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.003920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.004570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.004849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.005555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.007160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.022497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 784/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.022497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.032094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910427b-87b9-4baa-bbe0-bb42ea810eae admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.038516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.039210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.043549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.043549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] PATH_INFO: `/v3/projects/fa97c815ed7241968ed773a1442cd2b2/users/e5014c331aa04771ac313ffbd2ea19b9/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.058417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa97c815ed7241968ed773a1442cd2b2, user_id=e5014c331aa04771ac313ffbd2ea19b9, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.059648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:14:00.059648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:14:00.059648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:14:00.061700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.068281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 803/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:13:59 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:00.069479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.081889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d850-76bb-4695-90b3-4e5c66991a54 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.086723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.087480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.087821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.088088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.088728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.090771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.101116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:00.172695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 785/1588] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:00 2022] PUT /identity/v3/projects/fa97c815ed7241968ed773a1442cd2b2/users/e5014c331aa04771ac313ffbd2ea19b9/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:00.174476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.194492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 804/1589] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:00.196455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.208817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbdf7b-bf8c-456a-b45e-9087641203e2 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.255124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90499ec3-9af3-44a2-b373-918a5a1213f8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.260606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.261300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.261606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.261839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.262499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.264099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.277838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 786/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.278831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.283637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.284663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.285172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.285871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.286542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.288477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.291358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507887e-3b4e-445a-b18b-81a153f2b549 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.297775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.298671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.299269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.299835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.300641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.302523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.306592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 805/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.306592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.319382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb809747-1b47-4c08-bad7-738651203597 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.321913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 787/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.323182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.325491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998431b4-0017-4d32-a026-a14592c2cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.326166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998431b4-0017-4d32-a026-a14592c2cbdf admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.326644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998431b4-0017-4d32-a026-a14592c2cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.326928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998431b4-0017-4d32-a026-a14592c2cbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.327586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998431b4-0017-4d32-a026-a14592c2cbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.329574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998431b4-0017-4d32-a026-a14592c2cbdf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.336217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66302266-e212-48bf-995c-a5a067f2cc28 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.341577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 806/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.342697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.342990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.343270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.345200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.345879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.347235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.347235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.347235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.349269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.363010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 788/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.368051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.368177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:00.368177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:00.379264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 807/1595] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:00.379452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bdd86-903d-40c3-8ef6-881b991c8b77 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.379564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.381962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.382579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.382866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.383675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.384415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.386352 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.391311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e6cde-6016-4dfb-83dc-58cce9daf219 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.396895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.397694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.397989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.398267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.399504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.399719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 789/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.400867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.401519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.412428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e3605-d7c4-4161-b240-1a90c9d0dc1e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.413089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 808/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.413593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.423734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.425413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.425413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.425877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] PATH_INFO: `/v3/projects/5e4b89ee940b44288eeb8df4e7ff05e6/users/a8d45c56468d4b76945d4c47b2936133/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.434412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148002bc-ea27-44a6-a496-fd5d170625b4 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.439926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.440843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.441423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.441976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.442714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.443428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4b89ee940b44288eeb8df4e7ff05e6, user_id=a8d45c56468d4b76945d4c47b2936133, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.444460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.447387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.459567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 809/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.459567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.468775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5b424-1583-4db0-af6e-e7a244c1408d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.473667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.475082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.475537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.475825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] PATH_INFO: `/v3/projects/935757e55bdc49e6a89b468d3c16e2ae/users/a5ee4b8a68b142b3a367bd78eb3aeb39/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.499300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935757e55bdc49e6a89b468d3c16e2ae, user_id=a5ee4b8a68b142b3a367bd78eb3aeb39, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.502700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.536018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 790/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:00 2022] PUT /identity/v3/projects/5e4b89ee940b44288eeb8df4e7ff05e6/users/a8d45c56468d4b76945d4c47b2936133/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:00.538225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.595070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:00.605023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 810/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:00 2022] PUT /identity/v3/projects/935757e55bdc49e6a89b468d3c16e2ae/users/a5ee4b8a68b142b3a367bd78eb3aeb39/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:00.606147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.647236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910373-eccc-4251-af6c-93fb4f75c617 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.685744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b90a8-a5b0-4634-955d-603d9b143a44 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.689802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.690455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.690890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.691173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.715236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.716160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.716752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.717057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.717853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.719745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.732771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 791/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.734041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.748005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c680d-84a3-405c-b71b-7df747fa870e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.754289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.755077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.755509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.756452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.757618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.760806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.767812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:00.788056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 792/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:00.789476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.802741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32cbd-61aa-4b91-b5a5-c636e5cfee02 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.809635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3599f96-0cae-477f-9195-f5c6e2508a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.810322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599f96-0cae-477f-9195-f5c6e2508a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.810604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599f96-0cae-477f-9195-f5c6e2508a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.810889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3599f96-0cae-477f-9195-f5c6e2508a3c admin admin] PATH_INFO: `/v3/projects/4a838da311ec4756977bf27b6e877811/users/fd31fd2d516f4f0791db3484a99013e8/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.831758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3599f96-0cae-477f-9195-f5c6e2508a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a838da311ec4756977bf27b6e877811, user_id=fd31fd2d516f4f0791db3484a99013e8, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.833051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.835110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3599f96-0cae-477f-9195-f5c6e2508a3c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.845164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.863802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 811/1603] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:00.864839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:00.876314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d58f87-fea5-4091-a035-e9e6a80cd080 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:00.882161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c61c2-bdd2-4b5c-870e-98a6834eb5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:00.883787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c61c2-bdd2-4b5c-870e-98a6834eb5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.884128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c61c2-bdd2-4b5c-870e-98a6834eb5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.884413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c61c2-bdd2-4b5c-870e-98a6834eb5e7 admin admin] PATH_INFO: `/v3/projects/af7cf649edeb4f1e93f42a6a8d962820/users/bb7eabbe33b948e8af562ecc310a2bbb/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.905715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c61c2-bdd2-4b5c-870e-98a6834eb5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7cf649edeb4f1e93f42a6a8d962820, user_id=bb7eabbe33b948e8af562ecc310a2bbb, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:00.908758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c61c2-bdd2-4b5c-870e-98a6834eb5e7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:00.934981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 793/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:00 2022] PUT /identity/v3/projects/4a838da311ec4756977bf27b6e877811/users/fd31fd2d516f4f0791db3484a99013e8/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:00.934981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:00.934981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:00.934981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:00.981330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] MFA Rules not processed for user `a8d45c56468d4b76945d4c47b2936133`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:00.982791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.115968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 812/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:00 2022] PUT /identity/v3/projects/af7cf649edeb4f1e93f42a6a8d962820/users/bb7eabbe33b948e8af562ecc310a2bbb/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:01.115968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.115968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.115968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.115968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.119717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.120508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 794/1606] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.120508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.209641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:01.233072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 813/1607] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.233072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.253140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b01da-a17d-4f71-84bb-265065460e1c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.270386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee453f77-07e6-4307-8ff6-b8b89dfeab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.272039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee453f77-07e6-4307-8ff6-b8b89dfeab59 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.272541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee453f77-07e6-4307-8ff6-b8b89dfeab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.273156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee453f77-07e6-4307-8ff6-b8b89dfeab59 admin admin] PATH_INFO: `/v3/projects/156c69f350994866bb99d4e40d8b0600/users/b7707d0a63634400b3355c3d2d1654f3/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.274268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37433c6-78be-4929-bfa2-33f97c5345f8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.281868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ac08-3d7a-4517-a278-e4955aebaf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.282639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ac08-3d7a-4517-a278-e4955aebaf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.282999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ac08-3d7a-4517-a278-e4955aebaf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.283710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ac08-3d7a-4517-a278-e4955aebaf48 admin admin] PATH_INFO: `/v3/projects/08e7aea1bb6e436284d2703dd589d633/users/8985799a050e4fa892787f1f56ba9aff/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.303589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee453f77-07e6-4307-8ff6-b8b89dfeab59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156c69f350994866bb99d4e40d8b0600, user_id=b7707d0a63634400b3355c3d2d1654f3, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.308511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee453f77-07e6-4307-8ff6-b8b89dfeab59 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.308866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685ac08-3d7a-4517-a278-e4955aebaf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e7aea1bb6e436284d2703dd589d633, user_id=8985799a050e4fa892787f1f56ba9aff, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.314130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685ac08-3d7a-4517-a278-e4955aebaf48 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.409269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 795/1608] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:01 2022] PUT /identity/v3/projects/156c69f350994866bb99d4e40d8b0600/users/b7707d0a63634400b3355c3d2d1654f3/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:01.410908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.411206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.411468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.443549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 814/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:01 2022] PUT /identity/v3/projects/08e7aea1bb6e436284d2703dd589d633/users/8985799a050e4fa892787f1f56ba9aff/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:01.445035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.445621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.445911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.448887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] MFA Rules not processed for user `fd31fd2d516f4f0791db3484a99013e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.450327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.468430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.469867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.569843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 796/1610] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.572125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.598534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 815/1611] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.599491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.638409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:01.652307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d161a-180c-4ab7-b8ec-9944712959ed None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.656604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b176a-632f-42ab-b931-8770dc0d71c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.657331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b176a-632f-42ab-b931-8770dc0d71c7 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.657715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b176a-632f-42ab-b931-8770dc0d71c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.657983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b176a-632f-42ab-b931-8770dc0d71c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.688443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4540-f2e5-4333-9256-7242d050a06e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.692860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e77bff-0ef6-4349-b55c-751a79815baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.693666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e77bff-0ef6-4349-b55c-751a79815baa service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.694342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e77bff-0ef6-4349-b55c-751a79815baa service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.694342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e77bff-0ef6-4349-b55c-751a79815baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.708908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e77bff-0ef6-4349-b55c-751a79815baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.710579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e77bff-0ef6-4349-b55c-751a79815baa service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.726421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 816/1612] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:01.728685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.729272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.730542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.745376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:01.754638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b176a-632f-42ab-b931-8770dc0d71c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.756137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b176a-632f-42ab-b931-8770dc0d71c7 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.769106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] MFA Rules not processed for user `b7707d0a63634400b3355c3d2d1654f3`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.770398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.785278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 797/1613] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:01.788103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.788594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.788892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.843661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:01.845102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:01.866318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 798/1614] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.868860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.886156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c4ed-c59e-4831-bbb5-e043c4fb0fae None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.896793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 817/1615] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:01.898116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.907652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.908288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.908577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.908860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.909564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.911055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda926-beb6-4289-a0d4-1e380f687f27 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:01.911586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.921712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:01.921712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:01.921712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:01.921712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:01.939031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:01.951583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:01.974373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 818/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:01.978014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:01.996629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa835-ad83-4965-a762-97c925ccc863 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.001705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.002895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.004488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.004774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.031279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.033710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.049289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 819/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:02.055892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.062181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 799/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:01 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:02.064305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.069685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab43a-1dd1-480d-8ebe-f383e8988a59 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.222690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a0f97-103c-4abb-9e9e-82fbc670ec46 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.229889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.230800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.231093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.231368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.232306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.234636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.241804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.243002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.245206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.245206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.245206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.246674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.406239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 820/1619] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/projects => generated 363 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:02.417919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 800/1620] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/users => generated 290 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:02.425557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.428476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.442624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5a0f7-1524-4d4d-bf64-6062faae56a3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.472606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.567853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e69b0-a3cf-4d65-bec9-b3413e1d64ac admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.574356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.575252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.575639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.576018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.576765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.579016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.599305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.599946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.600208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.600485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.601174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.606734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.633037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 801/1621] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:02.634108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.652706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73eda3-65f5-40ac-a922-97d297269b09 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.670731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.671432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.671720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.676273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] PATH_INFO: `/v3/projects/2a2957634d9a4e8889f8ccde570bc515/users/4adf16951dde4012aacd3eb36e9f3fea/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.705314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2957634d9a4e8889f8ccde570bc515, user_id=4adf16951dde4012aacd3eb36e9f3fea, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.708320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.708881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 821/1622] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:02 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:02.713017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.736524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265f7cd-d910-418c-9e71-a2160eff5c80 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.748616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.749295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.749581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.749862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.752708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.754404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.785908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 822/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:02.787341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.811754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87baa-8ab5-46b1-9acf-33d47a99e3eb admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:02.821090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:02.825850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:02.825850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:02.825850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] PATH_INFO: `/v3/projects/a411651d1ad14bdb9f4c1c000f5605b0/users/e6840b5544c948d1a48ef23dd95fe0f4/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:02.826242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 802/1624] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:02 2022] PUT /identity/v3/projects/2a2957634d9a4e8889f8ccde570bc515/users/4adf16951dde4012aacd3eb36e9f3fea/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:02.826805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:02.864746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a411651d1ad14bdb9f4c1c000f5605b0, user_id=e6840b5544c948d1a48ef23dd95fe0f4, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:02.867844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:02.923104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.981026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 823/1625] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:02 2022] PUT /identity/v3/projects/a411651d1ad14bdb9f4c1c000f5605b0/users/e6840b5544c948d1a48ef23dd95fe0f4/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:02.982025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.019739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00964068-620f-48e0-94c7-e8413b418ece admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.085610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256ee17-5fd7-4a12-a8d4-1ad4cbe34d8f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.094577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.095268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.095594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.386017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.386017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.386017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.386017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 824/1626] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:03.386017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.386017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f7599-9dd8-46b7-b07e-f3b33fa3ac4d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.389311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.389311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.389311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.389311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.392520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.393820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c66f8-2980-44f0-96a5-632a2bc8475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.393820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c66f8-2980-44f0-96a5-632a2bc8475a admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.393820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c66f8-2980-44f0-96a5-632a2bc8475a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.393820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c66f8-2980-44f0-96a5-632a2bc8475a admin admin] PATH_INFO: `/v3/projects/a411651d1ad14bdb9f4c1c000f5605b0/users/e6840b5544c948d1a48ef23dd95fe0f4/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.394907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.395213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c66f8-2980-44f0-96a5-632a2bc8475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a411651d1ad14bdb9f4c1c000f5605b0, user_id=e6840b5544c948d1a48ef23dd95fe0f4, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.395213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c66f8-2980-44f0-96a5-632a2bc8475a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.395579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 803/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:03.395579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.395900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 825/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:03 2022] PUT /identity/v3/projects/a411651d1ad14bdb9f4c1c000f5605b0/users/e6840b5544c948d1a48ef23dd95fe0f4/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:03.395900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.395900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.395900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.396403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289fc0f-6c77-4de2-bbea-40703923a1da admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.396538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] MFA Rules not processed for user `e6840b5544c948d1a48ef23dd95fe0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:03.396538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.396538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 826/1629] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:03.396538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.404148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c7c5-6c23-4c2c-b8d5-efb50af35d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.404838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c7c5-6c23-4c2c-b8d5-efb50af35d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.405140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c7c5-6c23-4c2c-b8d5-efb50af35d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.405411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c7c5-6c23-4c2c-b8d5-efb50af35d6b admin admin] PATH_INFO: `/v3/projects/2a2957634d9a4e8889f8ccde570bc515/users/4adf16951dde4012aacd3eb36e9f3fea/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.411499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c7c5-6c23-4c2c-b8d5-efb50af35d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2957634d9a4e8889f8ccde570bc515, user_id=4adf16951dde4012aacd3eb36e9f3fea, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.418339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c7c5-6c23-4c2c-b8d5-efb50af35d6b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.445165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 804/1630] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:03 2022] PUT /identity/v3/projects/2a2957634d9a4e8889f8ccde570bc515/users/4adf16951dde4012aacd3eb36e9f3fea/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:03.465649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.466080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.466363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.522201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb4bfc-ea5c-4716-a478-fd6d5ae28319 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.534018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] MFA Rules not processed for user `4adf16951dde4012aacd3eb36e9f3fea`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:03.534951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:03.631932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.633687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.634076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.634289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.704096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 805/1631] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:03.732118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:03.758605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0c80e-c527-4e71-aa51-edc92d145816 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:03.768596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c578b-a9e7-4db6-882b-efcf97d5a97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:03.770176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c578b-a9e7-4db6-882b-efcf97d5a97a service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:03.770859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c578b-a9e7-4db6-882b-efcf97d5a97a service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:03.771520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c578b-a9e7-4db6-882b-efcf97d5a97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:03.780700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:03.783624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.785123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.794406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c578b-a9e7-4db6-882b-efcf97d5a97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:03.799405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c578b-a9e7-4db6-882b-efcf97d5a97a service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:03.811840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 827/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:03.838210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 806/1633] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:04.079232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:04.093461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7927ed-a3ee-4c84-aedf-79c31aa552a5 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:04.109362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:04.110108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:04.110398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:04.110843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:04.257366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:04.292404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:04.295181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:04.306736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 828/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:05.318776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:05.411946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:05.412401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:05.412565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:05.457529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] MFA Rules not processed for user `8985799a050e4fa892787f1f56ba9aff`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:05.462276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:05.575383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 807/1635] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:05.578394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:05.658061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128795-0359-430a-a8fa-c69cd815cc9b service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:05.663696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:05.664836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:05.665163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:05.665493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:05.666138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:05.668282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:05.721370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:05.804583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 829/1636] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:05 2022] POST /identity/v3/projects => generated 403 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:05.806689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab13d6-7970-4fd9-99c5-def4053db187 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:05.814992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.072798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.072798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.072798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.072798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] PATH_INFO: `/v3/users/b7707d0a63634400b3355c3d2d1654f3` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.073184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7707d0a63634400b3355c3d2d1654f3)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.073863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: WARNING py.warnings [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:14:06.073863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: warnings.warn(msg) Aug 30 01:14:06.073863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: Aug 30 01:14:06.080713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.092987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4c2a5-f2d3-4eaf-8add-ac8a30cf84b8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.106328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.107348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.107643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.107919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.108566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.112450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.228541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 830/1637] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:05 2022] POST /identity/v3/users => generated 308 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:06.233583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.282157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89397c8e-f345-42df-949d-620fe9fdc334 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.286814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.287508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.287815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.288098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.289077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.290712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.321657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 831/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:06.325695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.350844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830caadb-0ae1-48e4-878f-0ab711ad94e3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.381417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092af45-13d4-4691-8ecf-4192d103526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.382354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092af45-13d4-4691-8ecf-4192d103526b admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.382354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092af45-13d4-4691-8ecf-4192d103526b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.382665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092af45-13d4-4691-8ecf-4192d103526b admin admin] PATH_INFO: `/v3/projects/d23f4b84ec434544877269f6aa5cf7c0/users/ddb2f5d2dd1246169f2eecaf61ec1c5f/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.397903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7707d0a63634400b3355c3d2d1654f3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.422255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7707d0a63634400b3355c3d2d1654f3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.424121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7707d0a63634400b3355c3d2d1654f3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.425175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7707d0a63634400b3355c3d2d1654f3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.431380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092af45-13d4-4691-8ecf-4192d103526b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23f4b84ec434544877269f6aa5cf7c0, user_id=ddb2f5d2dd1246169f2eecaf61ec1c5f, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.434041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092af45-13d4-4691-8ecf-4192d103526b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.531081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-988abf3a-5f50-4f40-ada0-b13aec55d190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7707d0a63634400b3355c3d2d1654f3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:06.553350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 832/1639] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:06 2022] PUT /identity/v3/projects/d23f4b84ec434544877269f6aa5cf7c0/users/ddb2f5d2dd1246169f2eecaf61ec1c5f/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:06.566701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:06.567035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d22e6-ef61-489f-a367-57fe7a427a16 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.567276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d22e6-ef61-489f-a367-57fe7a427a16 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.568543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d22e6-ef61-489f-a367-57fe7a427a16 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.575960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 833/1640] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 30 01:14:06 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:06.579414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d22e6-ef61-489f-a367-57fe7a427a16 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.582729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-837d22e6-ef61-489f-a367-57fe7a427a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.616566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 808/1641] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:05 2022] DELETE /identity/v3/users/b7707d0a63634400b3355c3d2d1654f3 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:06.622105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b954629-a159-482b-82a1-5861925a525e None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.622635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b954629-a159-482b-82a1-5861925a525e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.624069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b954629-a159-482b-82a1-5861925a525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.664746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:06.725737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4b954629-a159-482b-82a1-5861925a525e None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.730285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4b954629-a159-482b-82a1-5861925a525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.734282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d22e6-ef61-489f-a367-57fe7a427a16 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:06.881063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 809/1642] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:06.883499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ececa-9073-4b04-a49a-2bc368a1ea77 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.883890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ececa-9073-4b04-a49a-2bc368a1ea77 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.884243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ececa-9073-4b04-a49a-2bc368a1ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.897800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b394ea-3f86-4536-b493-018fc9cc5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:06.898564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b394ea-3f86-4536-b493-018fc9cc5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.904833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b394ea-3f86-4536-b493-018fc9cc5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.904833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b394ea-3f86-4536-b493-018fc9cc5a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.904833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b394ea-3f86-4536-b493-018fc9cc5a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:06.904833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b394ea-3f86-4536-b493-018fc9cc5a00 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:06.926324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 834/1643] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:06.926524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-010ececa-9073-4b04-a49a-2bc368a1ea77 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:06.926614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a2d8-0c9b-42a6-9223-eb8ee77f0d3c None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.926614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a2d8-0c9b-42a6-9223-eb8ee77f0d3c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.926614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a2d8-0c9b-42a6-9223-eb8ee77f0d3c None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.926853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-010ececa-9073-4b04-a49a-2bc368a1ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:06.931940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 835/1644] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 30 01:14:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:06.939061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a2d8-0c9b-42a6-9223-eb8ee77f0d3c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:06.940825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 810/1645] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:06.943359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:06.943824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:06.944349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:06.998819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a2d8-0c9b-42a6-9223-eb8ee77f0d3c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.013622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.019344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.019344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.019344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] PATH_INFO: `/v3/projects/d23f4b84ec434544877269f6aa5cf7c0/users/ddb2f5d2dd1246169f2eecaf61ec1c5f/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.019692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:07.021735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.022613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23f4b84ec434544877269f6aa5cf7c0, user_id=ddb2f5d2dd1246169f2eecaf61ec1c5f, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.030275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.053128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 811/1646] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:07.054266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.064155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 836/1647] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:06 2022] PUT /identity/v3/projects/d23f4b84ec434544877269f6aa5cf7c0/users/ddb2f5d2dd1246169f2eecaf61ec1c5f/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:07.066367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:07.069291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.076839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:07.222142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089f268-7f31-4bf4-848c-d5d1cc9ac25f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.227304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.227967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.228427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.228719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.267221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaf6f-79cb-496e-86a1-3e442bb2403c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:07.387677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecafa6f-bf0a-48e4-b55a-8c7886cd07bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:07.388331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecafa6f-bf0a-48e4-b55a-8c7886cd07bd service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:07.388622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecafa6f-bf0a-48e4-b55a-8c7886cd07bd service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:07.388908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecafa6f-bf0a-48e4-b55a-8c7886cd07bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:07.404416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.407110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.437811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 837/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:07.522371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecafa6f-bf0a-48e4-b55a-8c7886cd07bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:07.523071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecafa6f-bf0a-48e4-b55a-8c7886cd07bd service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:07.554307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 812/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:08.781067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:09.342660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.345147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.376634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670ee2c-c8d1-42c7-8d5d-7136b0c08669 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:09.393405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:09.393405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.393405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.393405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] PATH_INFO: `/v3/projects/156c69f350994866bb99d4e40d8b0600` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.394022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] RBAC: Authorizing `identity:delete_project(project_id=156c69f350994866bb99d4e40d8b0600)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:09.395137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: WARNING py.warnings [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:14:09.395137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: warnings.warn(msg) Aug 30 01:14:09.395137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: Aug 30 01:14:09.396242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:09.574268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156c69f350994866bb99d4e40d8b0600', 'request_id': 'req-c4373405-0ca9-414d-99d3-a2b6ef2d625b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.711988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156c69f350994866bb99d4e40d8b0600', 'request_id': 'req-c4373405-0ca9-414d-99d3-a2b6ef2d625b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.713785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:09.751368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156c69f350994866bb99d4e40d8b0600', 'request_id': 'req-c4373405-0ca9-414d-99d3-a2b6ef2d625b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.783065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e9a44-a10e-437e-9fa4-eeb21eb3a3f9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:09.784321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e9a44-a10e-437e-9fa4-eeb21eb3a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:09.787963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e9a44-a10e-437e-9fa4-eeb21eb3a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:09.813361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] The token cache is being invalidate because project 156c69f350994866bb99d4e40d8b0600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:09.814158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.816295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:09.822913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 838/1650] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:09 2022] DELETE /identity/v3/projects/156c69f350994866bb99d4e40d8b0600 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:09.824927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:09.827706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:09.859192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ed3e9a44-a10e-437e-9fa4-eeb21eb3a3f9 None None] MFA Rules not processed for user `e785778ee1764ea9ade06b8c7515d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:09.860513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ed3e9a44-a10e-437e-9fa4-eeb21eb3a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.029051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373405-0ca9-414d-99d3-a2b6ef2d625b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:10.053085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 813/1651] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:10.053333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:10.053333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.053333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.053627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] PATH_INFO: `/v3/users/e6840b5544c948d1a48ef23dd95fe0f4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.061711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6840b5544c948d1a48ef23dd95fe0f4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:10.062450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d72e-41af-4ec4-8e79-f6afcb48960a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.062752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d72e-41af-4ec4-8e79-f6afcb48960a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.063043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d72e-41af-4ec4-8e79-f6afcb48960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.063685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.108684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5a25d72e-41af-4ec4-8e79-f6afcb48960a None None] MFA Rules not processed for user `e785778ee1764ea9ade06b8c7515d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:10.111942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5a25d72e-41af-4ec4-8e79-f6afcb48960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.135041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 814/1652] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:10.177479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791227-c455-4ab0-9093-b077b03a0a99 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.177881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791227-c455-4ab0-9093-b077b03a0a99 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.183642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791227-c455-4ab0-9093-b077b03a0a99 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.185727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 815/1653] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 30 01:14:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:10.192563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.193613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.194116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.235688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:10.237185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:10.336224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6840b5544c948d1a48ef23dd95fe0f4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.347044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6840b5544c948d1a48ef23dd95fe0f4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.370899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6840b5544c948d1a48ef23dd95fe0f4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.404005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 816/1654] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:10.410284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:10.423784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a769ef-5a5b-4509-91ec-52e57d71e301 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:10.439120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4aa03-027e-4a8f-a0c0-17ad20c5f91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:10.439780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4aa03-027e-4a8f-a0c0-17ad20c5f91d service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:10.440435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4aa03-027e-4a8f-a0c0-17ad20c5f91d service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:10.440638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4aa03-027e-4a8f-a0c0-17ad20c5f91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:10.472531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4aa03-027e-4a8f-a0c0-17ad20c5f91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:10.474933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4aa03-027e-4a8f-a0c0-17ad20c5f91d service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:10.494340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 817/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:10.523237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6840b5544c948d1a48ef23dd95fe0f4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.543443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4cfefb25-57a8-44d8-8753-6a417ba7f89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6840b5544c948d1a48ef23dd95fe0f4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:10.557204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 839/1656] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:09 2022] DELETE /identity/v3/users/e6840b5544c948d1a48ef23dd95fe0f4 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:10.850109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:11.058073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf029c-bb55-431b-8371-878d83ae30be None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.058576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf029c-bb55-431b-8371-878d83ae30be None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.058666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf029c-bb55-431b-8371-878d83ae30be None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.059968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 818/1657] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 30 01:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:11.072321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d5f25-df02-49ad-bc9a-fc03af0e95cf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.072675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d5f25-df02-49ad-bc9a-fc03af0e95cf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.073003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d5f25-df02-49ad-bc9a-fc03af0e95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.122944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-019d5f25-df02-49ad-bc9a-fc03af0e95cf None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:11.133536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-019d5f25-df02-49ad-bc9a-fc03af0e95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.360618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 840/1658] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:11.374219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf029c-bb55-431b-8371-878d83ae30be None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.376039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-bbaf029c-bb55-431b-8371-878d83ae30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.487894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:11.563579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf029c-bb55-431b-8371-878d83ae30be None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:11.574373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:11.575240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.575431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.575695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.598391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:11.599860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:11.639015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 819/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:11.640660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:11.640962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:11.641254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:11.719444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] MFA Rules not processed for user `ddb2f5d2dd1246169f2eecaf61ec1c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:11.722759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:11.887118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 841/1660] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:11.904043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:11.905626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:12.126663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b045b-a76f-4e52-bc3f-178886c7427b service glance] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:12.137772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:12.138693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:12.139114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:12.139661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] PATH_INFO: `/v3/projects/a411651d1ad14bdb9f4c1c000f5605b0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:12.143005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a411651d1ad14bdb9f4c1c000f5605b0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:12.145507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:12.285913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a411651d1ad14bdb9f4c1c000f5605b0', 'request_id': 'req-79c1503c-ac55-4d58-8aae-7caebee69911'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.317953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a411651d1ad14bdb9f4c1c000f5605b0', 'request_id': 'req-79c1503c-ac55-4d58-8aae-7caebee69911'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.325224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:12.327371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:12.339769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a411651d1ad14bdb9f4c1c000f5605b0', 'request_id': 'req-79c1503c-ac55-4d58-8aae-7caebee69911'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.369519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850df2e-c67c-4f88-9936-03d5cd5c06b3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:12.421592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] The token cache is being invalidate because project a411651d1ad14bdb9f4c1c000f5605b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:12.422152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.423008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-79c1503c-ac55-4d58-8aae-7caebee69911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.425125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 820/1661] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:11 2022] DELETE /identity/v3/projects/a411651d1ad14bdb9f4c1c000f5605b0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:12.429831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ec23-87f1-44a2-9efd-deb1c82a0ac5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:12.430580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ec23-87f1-44a2-9efd-deb1c82a0ac5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:12.431006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ec23-87f1-44a2-9efd-deb1c82a0ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:12.464728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9771ec23-87f1-44a2-9efd-deb1c82a0ac5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:12.466247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9771ec23-87f1-44a2-9efd-deb1c82a0ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:12.547518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:12.549796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:12.550483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:12.552026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:12.552316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] PATH_INFO: `/v3/users/fd31fd2d516f4f0791db3484a99013e8` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:12.568024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd31fd2d516f4f0791db3484a99013e8)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:12.572054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:12.682039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 821/1662] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:12.727628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a18abe-e974-47bf-ba8f-c337a74faf62 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:12.728033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a18abe-e974-47bf-ba8f-c337a74faf62 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:12.731781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a18abe-e974-47bf-ba8f-c337a74faf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:12.809628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-76a18abe-e974-47bf-ba8f-c337a74faf62 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:12.815514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-76a18abe-e974-47bf-ba8f-c337a74faf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:12.847482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd31fd2d516f4f0791db3484a99013e8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.847682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 822/1663] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:12.850447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906db55-2ec5-4f5a-993f-1839a61d8534 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:12.850737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906db55-2ec5-4f5a-993f-1839a61d8534 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:12.851019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906db55-2ec5-4f5a-993f-1839a61d8534 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:12.854716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd31fd2d516f4f0791db3484a99013e8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.866030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd31fd2d516f4f0791db3484a99013e8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:12.867671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 823/1664] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 30 01:14:12 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:12.868646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906db55-2ec5-4f5a-993f-1839a61d8534 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:12.921698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906db55-2ec5-4f5a-993f-1839a61d8534 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:12.952060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:12.952835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:12.953157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:12.969446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:12.970341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:12.971510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:12.972556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec37d69-6bd3-471e-ab26-f047d90368a8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:12.974633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd31fd2d516f4f0791db3484a99013e8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.002378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd31fd2d516f4f0791db3484a99013e8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:13.016552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 824/1665] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:13.017902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adec0-06eb-4c8a-b0d8-b89458a3f6f5 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.018192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adec0-06eb-4c8a-b0d8-b89458a3f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.021797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adec0-06eb-4c8a-b0d8-b89458a3f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.024148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 842/1666] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:12 2022] DELETE /identity/v3/users/fd31fd2d516f4f0791db3484a99013e8 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:13.025209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.031569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.146184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-764adec0-06eb-4c8a-b0d8-b89458a3f6f5 None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:13.147548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-764adec0-06eb-4c8a-b0d8-b89458a3f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.197571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df64b-54dc-4501-b1c9-0a2b6378e506 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.204027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.204868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.205321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.205755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.206544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.208727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.239575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:13.327540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 825/1667] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:13.329230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.329701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.330170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.345376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 843/1668] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/projects => generated 399 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:13.349578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.354429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.375375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:13.376878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:13.472915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 826/1669] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:13.474074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.493154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590d662-577c-4ddb-9e0d-4f3ba01b6b75 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.519237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.520069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.520548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.521049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.521922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.525471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.527123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b59-4abb-443a-9185-fa396edc46ff admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.546693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.547398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.547690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.548115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.563595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.567320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.580136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 844/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:13.606704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.618327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b18a2-75cc-4a13-9c42-83bbe5d6d433 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.625511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.626194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.626483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.626765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.646483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.657594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.666115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 845/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:13.695501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 827/1672] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:13.696899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.715480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b967-5b6c-4d7a-8d7f-00f3eda11455 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.734779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.736471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.736767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.737079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.737748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.752052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.786725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 846/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:13.790933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.803724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bbccd-e492-40d1-b501-9db52aa2290c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.818807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb819c7-420e-4fe6-b7aa-cf87856a72ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.819580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb819c7-420e-4fe6-b7aa-cf87856a72ff admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.820468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb819c7-420e-4fe6-b7aa-cf87856a72ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.820995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb819c7-420e-4fe6-b7aa-cf87856a72ff admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.832315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb819c7-420e-4fe6-b7aa-cf87856a72ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.832315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb819c7-420e-4fe6-b7aa-cf87856a72ff admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.844677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 828/1674] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:13.848830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:13.864100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0498a6-3c8f-41ba-ba02-e4b9886b7ebc admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:13.879825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8fef-61b8-4e6e-add4-8dd3b9b2c8b4 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.880419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8fef-61b8-4e6e-add4-8dd3b9b2c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.880844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e8fef-61b8-4e6e-add4-8dd3b9b2c8b4 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.884106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 829/1675] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:13.899811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021d1d5-80f3-4429-a226-3915944c2403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:13.899811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021d1d5-80f3-4429-a226-3915944c2403 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.899811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021d1d5-80f3-4429-a226-3915944c2403 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.899811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021d1d5-80f3-4429-a226-3915944c2403 admin admin] PATH_INFO: `/v3/projects/cc830fc9d40b48f7ab78986c6bf3b1bc/users/40b42177062d4a488714eae9cd4bb745/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:13.927457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021d1d5-80f3-4429-a226-3915944c2403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc830fc9d40b48f7ab78986c6bf3b1bc, user_id=40b42177062d4a488714eae9cd4bb745, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:13.931090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021d1d5-80f3-4429-a226-3915944c2403 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:13.954176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:13.954176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:13.954176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.014554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.016218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.088334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 847/1676] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:13 2022] PUT /identity/v3/projects/cc830fc9d40b48f7ab78986c6bf3b1bc/users/40b42177062d4a488714eae9cd4bb745/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:14.090401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.090716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.091082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.136814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] MFA Rules not processed for user `40b42177062d4a488714eae9cd4bb745`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:14.141013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.157122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 830/1677] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:14.251120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.258901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:14.286470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 848/1678] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:14.298896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.314757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d1e5-174d-4ca3-86ff-198f38899136 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.478334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.479060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.479353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.479625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.490293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a21b-4db7-4f33-ba71-0b45dfc50543 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.504251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.509864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.509864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.509864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.509864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.512148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.516219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.521416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.554163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 831/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:14.657250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 849/1680] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/projects => generated 401 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:14.658054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:14.696617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983d18-1f83-4a8c-9496-7a64c4a07a51 service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:14.879682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:14.880808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:14.881429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:14.881896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:14.885208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:14.887503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:14.993791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 832/1681] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:14 2022] POST /identity/v3/users => generated 307 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:14.999540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.015343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a7cd-4241-4071-a7fc-589bfce73d8d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.047712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.048360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.048638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.048921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.049687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.051263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.108549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 850/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:15.109137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.121302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f7508-a2e1-49e4-bca4-81f25caf22f2 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.127012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.127943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.128494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.129016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] PATH_INFO: `/v3/projects/aeea2ff9432240b28f75fbfaa0781ae0/users/fe2d528434634f3090f01b86ae80f0a8/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.155651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeea2ff9432240b28f75fbfaa0781ae0, user_id=fe2d528434634f3090f01b86ae80f0a8, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.155651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.353992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 833/1683] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:15 2022] PUT /identity/v3/projects/aeea2ff9432240b28f75fbfaa0781ae0/users/fe2d528434634f3090f01b86ae80f0a8/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:15.355760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.378616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d8ea8-9477-4b7d-83cc-68f0f9497fdf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.589642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.589992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.590283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.590607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.591520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.592829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.609447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:15.620836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.622759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 851/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:15.623683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.646227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bee55-41f5-4646-a84a-1d51824fea24 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.666755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751897d4-3d32-4020-950c-d26296d42e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.666755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751897d4-3d32-4020-950c-d26296d42e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.666755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751897d4-3d32-4020-950c-d26296d42e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.666755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751897d4-3d32-4020-950c-d26296d42e4e admin admin] PATH_INFO: `/v3/projects/aeea2ff9432240b28f75fbfaa0781ae0/users/fe2d528434634f3090f01b86ae80f0a8/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.669083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751897d4-3d32-4020-950c-d26296d42e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeea2ff9432240b28f75fbfaa0781ae0, user_id=fe2d528434634f3090f01b86ae80f0a8, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.671772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751897d4-3d32-4020-950c-d26296d42e4e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.696344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 852/1685] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:15 2022] PUT /identity/v3/projects/aeea2ff9432240b28f75fbfaa0781ae0/users/fe2d528434634f3090f01b86ae80f0a8/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:15.700892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856641f7-39fe-493c-b484-a815f0449bbc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.701211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856641f7-39fe-493c-b484-a815f0449bbc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.701496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856641f7-39fe-493c-b484-a815f0449bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.758217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:15.760498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6ee44-6fa4-43f2-a0e0-386d76e910ff admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:15.771850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-856641f7-39fe-493c-b484-a815f0449bbc None None] MFA Rules not processed for user `fe2d528434634f3090f01b86ae80f0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:15.777480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-856641f7-39fe-493c-b484-a815f0449bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.863549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:15.864579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.865147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.865793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.870227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.880738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 853/1686] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:15.882226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:15.883120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:15.883408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:15.906287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:15.909634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:15.916485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] MFA Rules not processed for user `e785778ee1764ea9ade06b8c7515d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:15.917767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:15.927871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 834/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:15.940464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:15.946518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:16.043037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 854/1688] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:16.109815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023545-a132-4455-85f8-ae131c7f220f service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.120335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.121176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.122267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.133859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.147700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.152446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.181815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 835/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:16.201249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.203261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:16.379297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b08b3-5562-441a-8548-8020caa18ae3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.394080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.394851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.395035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.395311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] PATH_INFO: `/v3/projects/4a838da311ec4756977bf27b6e877811` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.401136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a838da311ec4756977bf27b6e877811)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.405372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.500601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.511260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d883d-1fab-4cf1-99d6-7838f34b25a9 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.526200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.528705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.529065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.529358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:16.614121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a838da311ec4756977bf27b6e877811', 'request_id': 'req-ef87abb6-8641-4a16-aaa7-5927250ded3c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:16.717803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:16.718321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a838da311ec4756977bf27b6e877811', 'request_id': 'req-ef87abb6-8641-4a16-aaa7-5927250ded3c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:16.719500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:16.729229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a838da311ec4756977bf27b6e877811', 'request_id': 'req-ef87abb6-8641-4a16-aaa7-5927250ded3c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:16.738998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 836/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:16.783138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] The token cache is being invalidate because project 4a838da311ec4756977bf27b6e877811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:16.783498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:16.784927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:16.787238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 855/1691] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:16 2022] DELETE /identity/v3/projects/4a838da311ec4756977bf27b6e877811 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:16.792662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:16.810131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f54dcf-4de2-4f29-931b-7bd5cc063bd2 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:16.997351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:16.998266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:16.998718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:16.999198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] PATH_INFO: `/v3/users/4adf16951dde4012aacd3eb36e9f3fea` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.001418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adf16951dde4012aacd3eb36e9f3fea)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.005957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.206561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:17.208398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:17.237756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87abb6-8641-4a16-aaa7-5927250ded3c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:17.252416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:17.256167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:17.258364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:17.265426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] PATH_INFO: `/v3/users/8985799a050e4fa892787f1f56ba9aff` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:17.269647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8985799a050e4fa892787f1f56ba9aff)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:17.272369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:17.341469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adf16951dde4012aacd3eb36e9f3fea'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.361105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adf16951dde4012aacd3eb36e9f3fea'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.362066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adf16951dde4012aacd3eb36e9f3fea'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.363292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adf16951dde4012aacd3eb36e9f3fea'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.496764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adf16951dde4012aacd3eb36e9f3fea'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.559215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 837/1692] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:16 2022] DELETE /identity/v3/users/4adf16951dde4012aacd3eb36e9f3fea => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:17.644459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8985799a050e4fa892787f1f56ba9aff'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.648740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8985799a050e4fa892787f1f56ba9aff'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.686597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8985799a050e4fa892787f1f56ba9aff'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.821344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8985799a050e4fa892787f1f56ba9aff'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.841088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-17a8f2c0-a834-42cc-919c-61c7faf6f289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8985799a050e4fa892787f1f56ba9aff'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:17.851413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 856/1693] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:17 2022] DELETE /identity/v3/users/8985799a050e4fa892787f1f56ba9aff => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:17.929792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:18.812189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:18.813691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:18.917873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:19.022606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36f91-310c-4b70-ad95-62c7f620bdec admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.205939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.209129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.213877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.229152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] PATH_INFO: `/v3/projects/2a2957634d9a4e8889f8ccde570bc515` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.229152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2957634d9a4e8889f8ccde570bc515)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.229152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:19.458677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2957634d9a4e8889f8ccde570bc515', 'request_id': 'req-655624fd-fed1-4d82-9e87-d9373a423d5e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:19.467185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2957634d9a4e8889f8ccde570bc515', 'request_id': 'req-655624fd-fed1-4d82-9e87-d9373a423d5e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:19.486401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2957634d9a4e8889f8ccde570bc515', 'request_id': 'req-655624fd-fed1-4d82-9e87-d9373a423d5e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:19.517764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.518056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.523423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.594072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] MFA Rules not processed for user `bb7eabbe33b948e8af562ecc310a2bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:19.605586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] The token cache is being invalidate because project 2a2957634d9a4e8889f8ccde570bc515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:19.606183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:19.608830 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-655624fd-fed1-4d82-9e87-d9373a423d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:19.609499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:19.611066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 838/1694] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:18 2022] DELETE /identity/v3/projects/2a2957634d9a4e8889f8ccde570bc515 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:19.616156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.617274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.619494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.671125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:19.672566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:19.775479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 857/1695] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:19.776695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.785694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:19.811901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 839/1696] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:19.811901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:19.824067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:19.967845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84781a-ce82-48f0-8f87-69f6998688e5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:19.976549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:19.977585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:19.978082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:19.978621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] PATH_INFO: `/v3/users/a8d45c56468d4b76945d4c47b2936133` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:19.980637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d45c56468d4b76945d4c47b2936133)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:19.982895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:20.005793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfbabb-dc4f-4a3e-8b0b-c2e777b5cb94 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:20.014285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73b12b-e6d1-4cb3-bcbf-3139b951b995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:20.015075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73b12b-e6d1-4cb3-bcbf-3139b951b995 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.015560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73b12b-e6d1-4cb3-bcbf-3139b951b995 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.015837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73b12b-e6d1-4cb3-bcbf-3139b951b995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:20.040082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73b12b-e6d1-4cb3-bcbf-3139b951b995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:20.042372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73b12b-e6d1-4cb3-bcbf-3139b951b995 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:20.073426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 840/1697] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:20.075069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.075446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.075846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:20.145567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:20.146878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.155467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:20.164197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 841/1698] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:20.165127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:20.166792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.186759 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71702289-28c8-494f-8c84-f1bd85d710c6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:20.200456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:20.203339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.203653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.206768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] PATH_INFO: `/v3/projects/08e7aea1bb6e436284d2703dd589d633` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:20.206768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e7aea1bb6e436284d2703dd589d633)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:20.208733 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:20.374014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d45c56468d4b76945d4c47b2936133'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.376604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d45c56468d4b76945d4c47b2936133'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.408902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d45c56468d4b76945d4c47b2936133'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.470698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e7aea1bb6e436284d2703dd589d633', 'request_id': 'req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.535514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d45c56468d4b76945d4c47b2936133'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.544745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e7aea1bb6e436284d2703dd589d633', 'request_id': 'req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.571448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e7aea1bb6e436284d2703dd589d633', 'request_id': 'req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.572382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a90aa1df-bb08-4a31-ae28-3d181d95ae3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d45c56468d4b76945d4c47b2936133'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.599738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 858/1699] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:19 2022] DELETE /identity/v3/users/a8d45c56468d4b76945d4c47b2936133 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:20.603329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2b828-f655-488b-bee2-6a4cf345f776 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.610565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2b828-f655-488b-bee2-6a4cf345f776 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.613479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2b828-f655-488b-bee2-6a4cf345f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:20.700478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c2c2b828-f655-488b-bee2-6a4cf345f776 None None] MFA Rules not processed for user `e5014c331aa04771ac313ffbd2ea19b9`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:20.719017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c2c2b828-f655-488b-bee2-6a4cf345f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.808565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] The token cache is being invalidate because project 08e7aea1bb6e436284d2703dd589d633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:20.812769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.815554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:20.830019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 842/1700] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:20 2022] DELETE /identity/v3/projects/08e7aea1bb6e436284d2703dd589d633 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:20.832238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:20.852463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:20.971943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 859/1701] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:20.977713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:20.978069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:20.978277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.072526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:21.075771 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.096562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:21.263169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fed1a-9f9b-4f5d-9360-6dd44ebbbf44 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:21.298242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:21.344846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 860/1702] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:21.350426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.353777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.380868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5c231-5e59-4af6-97d0-e899b61518ec None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:21.391687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:21.396283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.396283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.396283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] PATH_INFO: `/v3/users/ddb2f5d2dd1246169f2eecaf61ec1c5f` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.401264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb2f5d2dd1246169f2eecaf61ec1c5f)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:21.403482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:21.430555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:21.431793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.432213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.432590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.433445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:21.435197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:21.440499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:21.461697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 843/1703] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 635 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:21.462966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.465229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.634488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f1cbb-e644-4de7-8533-245453165055 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:21.673609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:21.674243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.674528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.674802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.685214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:21.686827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:21.729282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb2f5d2dd1246169f2eecaf61ec1c5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.735187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb2f5d2dd1246169f2eecaf61ec1c5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.744596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 844/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:21.746556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.751889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:21.753839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb2f5d2dd1246169f2eecaf61ec1c5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.873959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0343eca-0913-463d-b5e9-61f1e4001509 service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:21.879361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:21.880726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:21.881196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:21.881826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:21.908909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:21.910412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:21.934773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 845/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:21.935915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:21.952127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb2f5d2dd1246169f2eecaf61ec1c5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:21.975326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9bb6d349-fa97-4f41-bb3f-9b73c46436da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb2f5d2dd1246169f2eecaf61ec1c5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:22.017346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3582e7-a6e8-4b9e-bb81-890d2214b898 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.017865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 861/1706] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:21 2022] DELETE /identity/v3/users/ddb2f5d2dd1246169f2eecaf61ec1c5f => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:22.206383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.207024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.207307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.207583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.208376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.210684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.254012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c42bd-3765-4561-9916-66008740ab7a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.254313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c42bd-3765-4561-9916-66008740ab7a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.254599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c42bd-3765-4561-9916-66008740ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.341175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b35c42bd-3765-4561-9916-66008740ab7a None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:22.343220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b35c42bd-3765-4561-9916-66008740ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.405557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 846/1707] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:21 2022] POST /identity/v3/projects => generated 381 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:22.408234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.411672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.522638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 862/1708] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:22.581286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de88801-0440-424a-b40e-44bd27e24fe3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.588962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.589402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.589996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.589996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.590839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.592950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.656854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b07d-3c0d-4edd-86b5-6243f86fc6f7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.657876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b07d-3c0d-4edd-86b5-6243f86fc6f7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.657876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b07d-3c0d-4edd-86b5-6243f86fc6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.703874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3ad6b07d-3c0d-4edd-86b5-6243f86fc6f7 None None] MFA Rules not processed for user `a5ee4b8a68b142b3a367bd78eb3aeb39`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:22.705306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3ad6b07d-3c0d-4edd-86b5-6243f86fc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.806183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 847/1709] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:22 2022] POST /identity/v3/users => generated 291 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:22.809590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.835262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd205d-8036-4bd7-a57d-193cfe108e8e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.846276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.849904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.850467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.851650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.858509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.861074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.877469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 863/1710] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:22.879779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844472f6-f942-42bf-b572-903396844550 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.880079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844472f6-f942-42bf-b572-903396844550 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.880369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844472f6-f942-42bf-b572-903396844550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.886587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 848/1711] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:22.892460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.903911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c3e00-8b75-44c0-9420-4e667ad26624 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:22.913157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:22.915738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:22.916422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:22.916908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:22.917819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:22.923310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:22.932753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-844472f6-f942-42bf-b572-903396844550 None None] MFA Rules not processed for user `a5ee4b8a68b142b3a367bd78eb3aeb39`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:22.934397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-844472f6-f942-42bf-b572-903396844550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.947962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 864/1712] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:22.969963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 849/1713] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:22.972363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.978783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844472f6-f942-42bf-b572-903396844550 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:22.980512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:22.982738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-844472f6-f942-42bf-b572-903396844550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:23.005984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844472f6-f942-42bf-b572-903396844550 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:23.016568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:23.026917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:23.026917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:23.026917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] PATH_INFO: `/v3/projects/d23f4b84ec434544877269f6aa5cf7c0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:23.026917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23f4b84ec434544877269f6aa5cf7c0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:23.026917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:23.124444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:23.162437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc37e5-ee73-4ed8-81ae-0005bb73fe15 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:23.170599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:23.171441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:23.171875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:23.172461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:23.188472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:23.190565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:23.233655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 850/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:23.235205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:23.255261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdad3c-6e61-49cb-bb6c-e2e6e2c10b54 service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:23.294994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23f4b84ec434544877269f6aa5cf7c0', 'request_id': 'req-839cffc4-98b4-44a9-8318-d60b7b34bf8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:23.395968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb8817-797c-4eff-9e5c-4177b4806b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:23.419126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8817-797c-4eff-9e5c-4177b4806b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:23.419126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8817-797c-4eff-9e5c-4177b4806b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:23.419126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8817-797c-4eff-9e5c-4177b4806b81 admin admin] PATH_INFO: `/v3/projects/08209ca932c845de843f839b8fbc58ae/users/6c118e0dac11477bb8f886c60441f5ed/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:23.419126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb8817-797c-4eff-9e5c-4177b4806b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08209ca932c845de843f839b8fbc58ae, user_id=6c118e0dac11477bb8f886c60441f5ed, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:23.422055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb8817-797c-4eff-9e5c-4177b4806b81 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:23.454533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23f4b84ec434544877269f6aa5cf7c0', 'request_id': 'req-839cffc4-98b4-44a9-8318-d60b7b34bf8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:23.464457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23f4b84ec434544877269f6aa5cf7c0', 'request_id': 'req-839cffc4-98b4-44a9-8318-d60b7b34bf8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:23.527946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] The token cache is being invalidate because project d23f4b84ec434544877269f6aa5cf7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:23.529928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:23.531054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:23.542976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 865/1715] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:22 2022] DELETE /identity/v3/projects/d23f4b84ec434544877269f6aa5cf7c0 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:23.542976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:23.545185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:23.723145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 851/1716] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:23 2022] PUT /identity/v3/projects/08209ca932c845de843f839b8fbc58ae/users/6c118e0dac11477bb8f886c60441f5ed/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:23.724606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e269-3171-44fb-a9c7-df9a066cbdcd None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:23.724998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e269-3171-44fb-a9c7-df9a066cbdcd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:23.725351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e269-3171-44fb-a9c7-df9a066cbdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:23.762919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cffc4-98b4-44a9-8318-d60b7b34bf8c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:23.769013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4391e269-3171-44fb-a9c7-df9a066cbdcd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:23.775211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4391e269-3171-44fb-a9c7-df9a066cbdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:23.902084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 852/1717] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:23.903604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:23.904483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:23.904483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:23.922415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:23.923667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:23.923667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:23.923857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:23.926081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:23.943947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] MFA Rules not processed for user `6c118e0dac11477bb8f886c60441f5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:23.945793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.048692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.050444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6cdf9-617b-4119-8416-0fe496c792b9 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.066124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 853/1718] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:24.067191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.068467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.077993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 866/1719] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:14:24.080561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475caa-b882-4e6a-9474-408837f9b5fd None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.080867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475caa-b882-4e6a-9474-408837f9b5fd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.081306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475caa-b882-4e6a-9474-408837f9b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.086329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbc94e-ed76-4b61-b604-70a143e8a3d3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.099441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.099441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.099441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.099441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] PATH_INFO: `/v3/projects/5e4b89ee940b44288eeb8df4e7ff05e6` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.099708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4b89ee940b44288eeb8df4e7ff05e6)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.100214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.161898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-05475caa-b882-4e6a-9474-408837f9b5fd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:24.161898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-05475caa-b882-4e6a-9474-408837f9b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.179310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 867/1720] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:24.183952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cc379-ac2a-4e82-8eca-e8c07494f337 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.184467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cc379-ac2a-4e82-8eca-e8c07494f337 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.188334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cc379-ac2a-4e82-8eca-e8c07494f337 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.190344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 868/1721] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 30 01:14:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:24.191345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cc379-ac2a-4e82-8eca-e8c07494f337 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.196203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7d9cc379-ac2a-4e82-8eca-e8c07494f337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.236993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cc379-ac2a-4e82-8eca-e8c07494f337 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:24.260820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:24.263642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.268156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.271072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.271072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:24.275568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:24.307369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4b89ee940b44288eeb8df4e7ff05e6', 'request_id': 'req-25bed92e-240e-4073-a4f5-bd8283e864dc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.320565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4b89ee940b44288eeb8df4e7ff05e6', 'request_id': 'req-25bed92e-240e-4073-a4f5-bd8283e864dc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.367616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4b89ee940b44288eeb8df4e7ff05e6', 'request_id': 'req-25bed92e-240e-4073-a4f5-bd8283e864dc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.728663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] The token cache is being invalidate because project 5e4b89ee940b44288eeb8df4e7ff05e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:24.728663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.729010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 869/1722] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/projects => generated 383 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:24.729107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-25bed92e-240e-4073-a4f5-bd8283e864dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:24.729183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:24.729183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:24.729334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 854/1723] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:24 2022] DELETE /identity/v3/projects/5e4b89ee940b44288eeb8df4e7ff05e6 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:24.729334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb4d6e-7408-4d3a-ab52-a33053ae1e56 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:24.729334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb4d6e-7408-4d3a-ab52-a33053ae1e56 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:24.729334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb4d6e-7408-4d3a-ab52-a33053ae1e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:24.786752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-edbb4d6e-7408-4d3a-ab52-a33053ae1e56 None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:24.789479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-edbb4d6e-7408-4d3a-ab52-a33053ae1e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.162914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523faf1-72c1-426c-97c8-f6b4f077416d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.162914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.162914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.162914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.165659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.165659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:25.165659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.165659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.166320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 855/1724] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:25.166320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12125d-e2b5-4914-9505-01e7ef784179 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.166320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12125d-e2b5-4914-9505-01e7ef784179 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.166320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12125d-e2b5-4914-9505-01e7ef784179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.167145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 870/1725] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:25.167145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.167145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.167548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2e12125d-e2b5-4914-9505-01e7ef784179 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:25.167548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2e12125d-e2b5-4914-9505-01e7ef784179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.168024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e0eb-f32e-4e6d-a634-e1e192b2ff62 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.168024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c1bb-0b18-479d-96df-b0a76dbf5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.168024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c1bb-0b18-479d-96df-b0a76dbf5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.168024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c1bb-0b18-479d-96df-b0a76dbf5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.168352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c1bb-0b18-479d-96df-b0a76dbf5bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.168352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c1bb-0b18-479d-96df-b0a76dbf5bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.168352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c1bb-0b18-479d-96df-b0a76dbf5bc9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.168597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 856/1726] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:25.168597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.168597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.168597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.226818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:25.228110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.245356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 857/1727] 10.222.0.84 () {58 vars in 1015 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:25.246323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.248169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.262289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4165-9b28-428a-9639-9496608cafb9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.267937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.268881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.269606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.270135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.282336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.284486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.301890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 858/1728] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:25.303404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.323682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32a74a-b979-4b89-9344-0bd0ca3712af service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.331091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:25.336062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.347161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.347161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.347161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.347161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.347161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.410603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 871/1729] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/users => generated 298 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:25.414781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.416993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.416993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.482986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:25.486360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:25.513085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 859/1730] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:25.516465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.840470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 872/1731] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:25.842501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.847079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5c59f-dd78-47fb-8005-03d5a8174170 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.871186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.875341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.875341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.875341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.876275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.876975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f34773-26cd-4b47-a728-086551600ac3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:25.879861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.895670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:25.896476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:25.900241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:25.902861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:25.904468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:25.909831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:25.929506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 860/1732] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:25.930744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:25.941781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:26.077238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 873/1733] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:25 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:26.078480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:26.092054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:26.134646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66db91-7673-4b40-831e-1054673bcb52 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.151740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.152585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.153010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.153404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] PATH_INFO: `/v3/users/40b42177062d4a488714eae9cd4bb745` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.155466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b42177062d4a488714eae9cd4bb745)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.157796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.261912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4f7a1-2d77-4d35-aadd-243229761439 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.279842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.283753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.285035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.287531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.337284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.345572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.389422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 861/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:26.390946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:26.422761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf0c1f-de43-46c2-8c45-2c253875ab62 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.453884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.454535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.454827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.455114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.455878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:26.456190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.458038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.484560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 862/1735] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:26.484560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:26.526386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfb697-16fd-4731-bc8f-7e33fd8e7828 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:26.552124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:26.552837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:26.553163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:26.553464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] PATH_INFO: `/v3/projects/0b9f729d6c3b4926b7ed5ba5cbdcb51c/users/995cbe9313fe46279a1898e057232ead/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:26.608718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b42177062d4a488714eae9cd4bb745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:26.614641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b42177062d4a488714eae9cd4bb745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:26.693190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b42177062d4a488714eae9cd4bb745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:26.693428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f729d6c3b4926b7ed5ba5cbdcb51c, user_id=995cbe9313fe46279a1898e057232ead, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:26.693428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:26.980902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b42177062d4a488714eae9cd4bb745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:26.996623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 863/1736] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:26 2022] PUT /identity/v3/projects/0b9f729d6c3b4926b7ed5ba5cbdcb51c/users/995cbe9313fe46279a1898e057232ead/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:27.004526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.040343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b42177062d4a488714eae9cd4bb745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:27.068055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 874/1737] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:26 2022] DELETE /identity/v3/users/40b42177062d4a488714eae9cd4bb745 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:27.073418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.093239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.166090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945c0ee-42e8-440b-97e1-722da34a35a6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.266129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45d303-12b6-4a49-acc0-373fd4c450e9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.279011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.279739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.280085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.280397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.281137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.284715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.317453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.318143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.318365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.318675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.319622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.321627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.357819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 864/1738] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:27.357819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.362168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.406498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c637-94d1-410f-8fa4-d9d60d26d725 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.438555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706debcd-1d44-4939-ab2c-3fa726dc167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.441681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706debcd-1d44-4939-ab2c-3fa726dc167c admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.441681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706debcd-1d44-4939-ab2c-3fa726dc167c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.441681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706debcd-1d44-4939-ab2c-3fa726dc167c admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.441681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706debcd-1d44-4939-ab2c-3fa726dc167c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.453787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706debcd-1d44-4939-ab2c-3fa726dc167c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.486140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 865/1739] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:27.493266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.493549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.493837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.502976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 875/1740] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:27 2022] POST /identity/v3/projects => generated 405 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:27.502976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.508445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.602381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:27.604734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:27.690558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525179a-4779-4fec-acfe-a4f1474c6363 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.700176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.701181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.701469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.701845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.703179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.705067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.717850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 866/1741] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:27.727865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:27.728032 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.780580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdf8c-4931-4dd3-acbf-6773b3d75908 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.791044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 876/1742] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:27.791044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:27.829146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328fde-2f76-4dbb-99c7-42b0a9afbe26 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:27.840658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.843018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.843304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.843672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] PATH_INFO: `/v3/projects/0b9f729d6c3b4926b7ed5ba5cbdcb51c/users/995cbe9313fe46279a1898e057232ead/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.851097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:27.851228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f729d6c3b4926b7ed5ba5cbdcb51c, user_id=995cbe9313fe46279a1898e057232ead, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.854521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.865611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:27.865611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:27.865611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:27.865611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:27.865611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:27.906505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 867/1743] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:27 2022] PUT /identity/v3/projects/0b9f729d6c3b4926b7ed5ba5cbdcb51c/users/995cbe9313fe46279a1898e057232ead/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:27.907372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.060640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 877/1744] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:27 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:28.062407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.067698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.087144 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142f26c-b67a-4d5c-af5a-2466e44b2b28 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.101228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391f131-95d0-4f01-af8c-04f4edd31a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.101228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f131-95d0-4f01-af8c-04f4edd31a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.101228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f131-95d0-4f01-af8c-04f4edd31a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.101228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f131-95d0-4f01-af8c-04f4edd31a58 admin admin] PATH_INFO: `/v3/projects/a13ad7b0bce84fe1a39f1d58279e085d/users/40b64e5fc56f46628bb96f9943695c61/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.119203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391f131-95d0-4f01-af8c-04f4edd31a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13ad7b0bce84fe1a39f1d58279e085d, user_id=40b64e5fc56f46628bb96f9943695c61, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.132612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391f131-95d0-4f01-af8c-04f4edd31a58 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.238399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf8523-9fc0-436e-a43e-d1f973fe5a17 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.346586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 868/1745] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:27 2022] PUT /identity/v3/projects/a13ad7b0bce84fe1a39f1d58279e085d/users/40b64e5fc56f46628bb96f9943695c61/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:28.347749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327b7e-5543-4226-9785-dd9e7fdaa375 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.348045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327b7e-5543-4226-9785-dd9e7fdaa375 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.348550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327b7e-5543-4226-9785-dd9e7fdaa375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.353753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.354607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.355021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.355404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.378763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.380480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.395347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 878/1746] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:28.396256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.408140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0c6dd-1c8b-4f05-8629-d5b272daba62 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.440236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f1327b7e-5543-4226-9785-dd9e7fdaa375 None None] MFA Rules not processed for user `995cbe9313fe46279a1898e057232ead`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:28.441555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f1327b7e-5543-4226-9785-dd9e7fdaa375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.623896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 869/1747] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:28.625588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.625711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.625971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.642116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.650062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.654624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.654624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.654624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.658655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.691002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 879/1748] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:28.693019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.696646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.702760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] MFA Rules not processed for user `40b64e5fc56f46628bb96f9943695c61`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:28.705933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:28.795507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 870/1749] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:28.796507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.810732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ced30-f8ac-4112-b728-c69617f55758 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.830874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.831821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.832210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.832711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.833771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.836127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.854959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 871/1750] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:28.856025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.865940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa14c-ef1c-4217-ae29-92021713cecd admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.867640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12119aaa-ff8b-486c-bcc5-b14b7793448b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.873251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.874023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.874615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.875063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.876208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.878693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.879828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.880462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.880814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.881139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:28.908199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:28.909799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:28.950947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 880/1751] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:28.950947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:28.961495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e3605-03c5-4a41-9f21-ebdc55336a9d service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:28.975594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:28.976507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:28.976885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:28.977338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] PATH_INFO: `/v3/projects/24b17a800ad74e019d672d2155bab40b/users/3d970bb89a934f1aa8b628b2f0c31909/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.031724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b17a800ad74e019d672d2155bab40b, user_id=3d970bb89a934f1aa8b628b2f0c31909, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.063939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.197539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 881/1752] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:28 2022] PUT /identity/v3/projects/24b17a800ad74e019d672d2155bab40b/users/3d970bb89a934f1aa8b628b2f0c31909/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:29.202766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.203005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 872/1753] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:28 2022] POST /identity/v3/projects => generated 363 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:29.219832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.363620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f871b-238c-497c-b770-cf96c60319b3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.423726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9bd86-6569-4649-ac87-95ad45bd79ed admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.436226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.437134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.437616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.437800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.438675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.440808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.546976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.548825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.549579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.550535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.558230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.782822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.787257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47413079-e4ea-43cc-8dc2-2c02f7dfcccd service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.843247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 882/1754] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:29.849713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.849713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.849713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.886056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 873/1755] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:29 2022] POST /identity/v3/users => generated 288 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:29.890148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:29.912389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f133-bc59-4bf7-92fc-6042ba33f497 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:29.916315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:29.919147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] MFA Rules not processed for user `3d970bb89a934f1aa8b628b2f0c31909`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:29.922307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:29.922475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:29.922475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:29.922782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:29.923159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:29.923924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:29.926596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:29.967526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 874/1756] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:29.968675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.005566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fec28-6f86-43dc-9d36-14eef2a9ba76 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.023284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.024280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.024571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.024856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] PATH_INFO: `/v3/projects/660a919ca2004c6bb8bf698bb8667cc2/users/7b6d379915d248feb6c11a22f6cae4a5/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.074213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=660a919ca2004c6bb8bf698bb8667cc2, user_id=7b6d379915d248feb6c11a22f6cae4a5, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.082730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.196137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 875/1757] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:29 2022] PUT /identity/v3/projects/660a919ca2004c6bb8bf698bb8667cc2/users/7b6d379915d248feb6c11a22f6cae4a5/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:30.198107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.201896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 883/1758] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:30.214206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.255554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ed432-781b-468c-b30d-b5297f818fbf None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.383571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f772e-92a2-4260-9122-7c45ee9fad1e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.383571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edca15e-9b06-4b1e-bd23-3d35fb2f3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.383571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edca15e-9b06-4b1e-bd23-3d35fb2f3498 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.383571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edca15e-9b06-4b1e-bd23-3d35fb2f3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.383935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edca15e-9b06-4b1e-bd23-3d35fb2f3498 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.383935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edca15e-9b06-4b1e-bd23-3d35fb2f3498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.383935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edca15e-9b06-4b1e-bd23-3d35fb2f3498 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.401288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 876/1759] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:30.401288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c0ff-8248-42af-b3dc-167eedf17769 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.401288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c0ff-8248-42af-b3dc-167eedf17769 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.401288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c0ff-8248-42af-b3dc-167eedf17769 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.402208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 877/1760] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:30.402930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c0ff-8248-42af-b3dc-167eedf17769 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.420196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c0ff-8248-42af-b3dc-167eedf17769 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:30.427893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9730cf1-25be-4367-b1b7-bf4a231dcdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.428686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9730cf1-25be-4367-b1b7-bf4a231dcdca admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.429093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9730cf1-25be-4367-b1b7-bf4a231dcdca admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.431434 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9730cf1-25be-4367-b1b7-bf4a231dcdca admin admin] PATH_INFO: `/v3/projects/660a919ca2004c6bb8bf698bb8667cc2/users/7b6d379915d248feb6c11a22f6cae4a5/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.436079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9730cf1-25be-4367-b1b7-bf4a231dcdca admin admin] RBAC: Authorizing `identity:create_grant(project_id=660a919ca2004c6bb8bf698bb8667cc2, user_id=7b6d379915d248feb6c11a22f6cae4a5, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.439147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9730cf1-25be-4367-b1b7-bf4a231dcdca admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.468761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 878/1761] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:30 2022] PUT /identity/v3/projects/660a919ca2004c6bb8bf698bb8667cc2/users/7b6d379915d248feb6c11a22f6cae4a5/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:30.487396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b3f7-e288-457e-919c-10d01c576707 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.488435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b3f7-e288-457e-919c-10d01c576707 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.489845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b3f7-e288-457e-919c-10d01c576707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.557754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:30.559214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.559523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.559860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.560526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:30.564274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:30.606737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-44b1b3f7-e288-457e-919c-10d01c576707 None None] MFA Rules not processed for user `7b6d379915d248feb6c11a22f6cae4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:30.606737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-44b1b3f7-e288-457e-919c-10d01c576707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:30.774667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 884/1762] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:30 2022] POST /identity/v3/projects => generated 405 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:30.787888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:30.807177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:30.842141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 879/1763] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:30.842141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:30.842141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:30.844533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:30.905440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:30.906848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.036659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3094e-9597-4873-ae65-4674691b7f53 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:31.036659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:31.036659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:31.036659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:31.036999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] PATH_INFO: `/v3/projects/cc830fc9d40b48f7ab78986c6bf3b1bc` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:31.036999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc830fc9d40b48f7ab78986c6bf3b1bc)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:31.036999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:31.140164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 880/1764] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:31.141451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:31.164196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53f02-916d-47bf-b925-595c05d45008 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:31.174149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:31.175354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:31.176051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:31.176539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:31.178049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:31.180674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:31.318261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 881/1765] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:31 2022] POST /identity/v3/users => generated 309 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:31.320610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:31.324766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.360583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc830fc9d40b48f7ab78986c6bf3b1bc', 'request_id': 'req-b5738994-9749-4f6c-a537-fb7204a515c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.476168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f9ec-c69f-4ee5-9186-b19bd8c7cee8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:31.507055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc830fc9d40b48f7ab78986c6bf3b1bc', 'request_id': 'req-b5738994-9749-4f6c-a537-fb7204a515c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.520369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc830fc9d40b48f7ab78986c6bf3b1bc', 'request_id': 'req-b5738994-9749-4f6c-a537-fb7204a515c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.726298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] The token cache is being invalidate because project cc830fc9d40b48f7ab78986c6bf3b1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:31.726298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.726298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:31.726298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 885/1766] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:30 2022] DELETE /identity/v3/projects/cc830fc9d40b48f7ab78986c6bf3b1bc => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:31.726298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:31.728508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:31.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:31.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:31.729039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:31.729478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.729752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738994-9749-4f6c-a537-fb7204a515c7 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:31.746944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:31.747585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:31.748355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:31.748355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:31.752414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:31.754949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:31.765569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:31.769401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:31.799290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 886/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:31.803103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:31.812273 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.830491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 882/1768] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:31.836773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:31.845753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:31.903134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc33cc-81f4-4125-84aa-b804b3d8ccca service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:31.918628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:31.924324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:31.924672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:31.924978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] PATH_INFO: `/v3/users/fe2d528434634f3090f01b86ae80f0a8` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:31.926735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2d528434634f3090f01b86ae80f0a8)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:31.929251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:31.991740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499a6ac-c917-4754-9c9d-f33c6afa7dd1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:32.015497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:32.016272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.016613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.017087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.029755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.082595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:32.082595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:32.133477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 887/1769] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:32.138261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:32.182781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a04a7-b9fa-4ec6-90e1-f2e602626c8e service nova] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:32.204820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac491828-f1f8-40ec-a458-54d545c3af2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:32.206019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491828-f1f8-40ec-a458-54d545c3af2e admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.207534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491828-f1f8-40ec-a458-54d545c3af2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.208064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491828-f1f8-40ec-a458-54d545c3af2e admin admin] PATH_INFO: `/v3/projects/23dab76730f240d0be527debf90a941d/users/5ff55aece11c4278b8fa1aa5b8d8e038/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.248410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac491828-f1f8-40ec-a458-54d545c3af2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dab76730f240d0be527debf90a941d, user_id=5ff55aece11c4278b8fa1aa5b8d8e038, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:32.251411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac491828-f1f8-40ec-a458-54d545c3af2e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:32.384312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 888/1770] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:32 2022] PUT /identity/v3/projects/23dab76730f240d0be527debf90a941d/users/5ff55aece11c4278b8fa1aa5b8d8e038/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:32.386243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.386378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.390589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.473365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] MFA Rules not processed for user `e5014c331aa04771ac313ffbd2ea19b9`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:32.482797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.511385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2d528434634f3090f01b86ae80f0a8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.554649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2d528434634f3090f01b86ae80f0a8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.556220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2d528434634f3090f01b86ae80f0a8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.557366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2d528434634f3090f01b86ae80f0a8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.668499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 889/1771] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:32.669739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:32.671707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.843603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463be00-d330-4c78-936b-0bfc617abba9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:32.851564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:32.853051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:32.853809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:32.855412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:32.858104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:32.868675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2d528434634f3090f01b86ae80f0a8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:32.920077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.007108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 883/1772] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:31 2022] DELETE /identity/v3/users/fe2d528434634f3090f01b86ae80f0a8 => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:33.008236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.022133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:33.128363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.128363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f4eb2-d8b7-4a61-9391-50d12c092c93 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.133567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 890/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:33.134915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.135219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.141494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.196409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] MFA Rules not processed for user `bb7eabbe33b948e8af562ecc310a2bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:33.198466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:33.329266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb11c88-ccd0-49c6-9141-dde43710fcc7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.346078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131fbe4-0625-4dae-a946-aab417640577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.347226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131fbe4-0625-4dae-a946-aab417640577 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.347744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131fbe4-0625-4dae-a946-aab417640577 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.348255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131fbe4-0625-4dae-a946-aab417640577 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.349281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131fbe4-0625-4dae-a946-aab417640577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.353759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 891/1774] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:33.353900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131fbe4-0625-4dae-a946-aab417640577 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.393517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 884/1775] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:33.394403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.439996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bf6b0-2592-437e-88f2-4cd1160afd1b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.455602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.455602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.455602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.455602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] PATH_INFO: `/v3/projects/23dab76730f240d0be527debf90a941d/users/5ff55aece11c4278b8fa1aa5b8d8e038/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.456032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dab76730f240d0be527debf90a941d, user_id=5ff55aece11c4278b8fa1aa5b8d8e038, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:33.457857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:33.485048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 892/1776] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:33 2022] PUT /identity/v3/projects/23dab76730f240d0be527debf90a941d/users/5ff55aece11c4278b8fa1aa5b8d8e038/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:33.496674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.497419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.497965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.547331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] MFA Rules not processed for user `5ff55aece11c4278b8fa1aa5b8d8e038`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:33.552647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:33.777006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 885/1777] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:33.787856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:33.790430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:33.919747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f00c4-0822-4290-8231-70da0dbcaa53 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:33.965499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8010004-cd2d-4abb-a733-babb1c0ca33c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:33.967778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010004-cd2d-4abb-a733-babb1c0ca33c service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:33.973259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010004-cd2d-4abb-a733-babb1c0ca33c service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:33.973602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8010004-cd2d-4abb-a733-babb1c0ca33c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:33.999412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010004-cd2d-4abb-a733-babb1c0ca33c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.001251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8010004-cd2d-4abb-a733-babb1c0ca33c service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:34.048243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 893/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:34.317745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:34.464247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd158-dbf4-4cc2-ad60-bb3820e9c5b6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:34.478153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:34.479687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:34.480796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:34.482229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] PATH_INFO: `/v3/users/3d970bb89a934f1aa8b628b2f0c31909` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:34.486177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d970bb89a934f1aa8b628b2f0c31909)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:34.494898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:35.602686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d970bb89a934f1aa8b628b2f0c31909'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:35.619889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d970bb89a934f1aa8b628b2f0c31909'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:35.622588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d970bb89a934f1aa8b628b2f0c31909'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:35.624728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d970bb89a934f1aa8b628b2f0c31909'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:35.802922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d970bb89a934f1aa8b628b2f0c31909'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:35.841321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 886/1779] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:34 2022] DELETE /identity/v3/users/3d970bb89a934f1aa8b628b2f0c31909 => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:35.845898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:35.846684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:35.846684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:35.905994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:35.907978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.018031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:36.020980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.105715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 894/1780] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:36.172000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:36.173682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.267235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0b482-a267-47fe-b644-6c916461f0df admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:36.281355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:36.283313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:36.283605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:36.283892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] PATH_INFO: `/v3/projects/aeea2ff9432240b28f75fbfaa0781ae0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:36.289824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeea2ff9432240b28f75fbfaa0781ae0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:36.291829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:36.326903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e1df-63cf-494d-b1f3-beb108f03961 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:36.356827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced4bb5-293d-46cf-bd2b-b4f00d4661e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:36.357662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced4bb5-293d-46cf-bd2b-b4f00d4661e8 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:36.363969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced4bb5-293d-46cf-bd2b-b4f00d4661e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:36.363969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced4bb5-293d-46cf-bd2b-b4f00d4661e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:36.378660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced4bb5-293d-46cf-bd2b-b4f00d4661e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:36.380367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced4bb5-293d-46cf-bd2b-b4f00d4661e8 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:36.456494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 895/1781] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:36.567863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeea2ff9432240b28f75fbfaa0781ae0', 'request_id': 'req-621ce0c2-6203-4618-bd2f-e5e9787c92b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:36.595698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeea2ff9432240b28f75fbfaa0781ae0', 'request_id': 'req-621ce0c2-6203-4618-bd2f-e5e9787c92b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:36.612160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeea2ff9432240b28f75fbfaa0781ae0', 'request_id': 'req-621ce0c2-6203-4618-bd2f-e5e9787c92b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:36.661979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:36.694264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] The token cache is being invalidate because project aeea2ff9432240b28f75fbfaa0781ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:36.695423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:36.696773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:36.701417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 887/1782] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:36 2022] DELETE /identity/v3/projects/aeea2ff9432240b28f75fbfaa0781ae0 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:36.706108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156d0d7-b6ab-4d2d-ac84-174797ef2389 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:36.706601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156d0d7-b6ab-4d2d-ac84-174797ef2389 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:36.707060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156d0d7-b6ab-4d2d-ac84-174797ef2389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:36.777358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9156d0d7-b6ab-4d2d-ac84-174797ef2389 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:36.778978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9156d0d7-b6ab-4d2d-ac84-174797ef2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.978655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:36.980469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:36.989084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 896/1783] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:37.001679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.003519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.005458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.015941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ce0c2-6203-4618-bd2f-e5e9787c92b3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.029845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:37.030747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.031121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.031460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] PATH_INFO: `/v3/users/6c118e0dac11477bb8f886c60441f5ed` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.032596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:37.034140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:37.036287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c118e0dac11477bb8f886c60441f5ed)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:37.050667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 897/1784] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:37.056147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:37.057767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:37.070302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9a50-f08e-48c2-8eb2-a050c122640a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.081125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:37.088401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.088401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.088401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.088401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:37.088401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:37.090510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:37.140192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 898/1785] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:37.140192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:37.154073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25dcc8-cc87-4336-a303-38bc8bd66297 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.159540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:37.160529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.161046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.161646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.162549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:37.166263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:37.332873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 899/1786] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:37 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:37.334094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:37.572316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c118e0dac11477bb8f886c60441f5ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.572316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c118e0dac11477bb8f886c60441f5ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.572316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c118e0dac11477bb8f886c60441f5ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.572316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c118e0dac11477bb8f886c60441f5ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.574035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d153-c640-4781-82d9-b2969be5acf1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.574035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:37.574035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.574035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.574862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.574862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:37.580193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:37.848609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e84834a0-0fd0-4e15-85b5-bee73e026846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c118e0dac11477bb8f886c60441f5ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:37.867886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 900/1787] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:37 2022] POST /identity/v3/users => generated 283 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:37.869558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:37.886554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:37.894127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 888/1788] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:36 2022] DELETE /identity/v3/users/6c118e0dac11477bb8f886c60441f5ed => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:37.901486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:37.902152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:37.904787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:37.928032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8214-b153-40f0-adba-5708342b1584 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:37.983845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:37.986360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.126855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.130211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.130211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.130211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.130211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.136513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.141538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 889/1789] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:38.142723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.145262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.160290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 901/1790] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:38.163977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda622-2e43-439e-96ce-f1b680ca9caa None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.166347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.179962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.180878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.181349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.182463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] PATH_INFO: `/v3/projects/24b17a800ad74e019d672d2155bab40b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.184443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b17a800ad74e019d672d2155bab40b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.186620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ddf4a-eca3-43e7-88cd-f3c69ee6f222 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.193260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.194457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.194757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.195577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.196336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.197484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.198421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.217864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 902/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:38.219365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.222769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.322197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735969b9-3ec3-4fb3-9725-750c11bcbc97 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.327339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.329233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.330960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.331259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.347018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.348646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.360237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 903/1792] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:38.360868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.372063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1759-3acb-4d2f-b622-cc9e1d653722 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.377453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95412702-c161-48ff-b69a-eefcb7f10ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.378217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95412702-c161-48ff-b69a-eefcb7f10ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.378664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95412702-c161-48ff-b69a-eefcb7f10ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.379053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95412702-c161-48ff-b69a-eefcb7f10ffb admin admin] PATH_INFO: `/v3/projects/bcefefd3382348d08dcaaa471a2d3000/users/1c06908726bd4abe9ae376c2d94faaf7/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.421046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95412702-c161-48ff-b69a-eefcb7f10ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcefefd3382348d08dcaaa471a2d3000, user_id=1c06908726bd4abe9ae376c2d94faaf7, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.424221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95412702-c161-48ff-b69a-eefcb7f10ffb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.584415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 904/1793] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:38 2022] PUT /identity/v3/projects/bcefefd3382348d08dcaaa471a2d3000/users/1c06908726bd4abe9ae376c2d94faaf7/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:38.595096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b17a800ad74e019d672d2155bab40b', 'request_id': 'req-ce54b672-6f17-45a5-982c-ca810d06ccec'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.597192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.597481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.597755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.603336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b17a800ad74e019d672d2155bab40b', 'request_id': 'req-ce54b672-6f17-45a5-982c-ca810d06ccec'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.612783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b17a800ad74e019d672d2155bab40b', 'request_id': 'req-ce54b672-6f17-45a5-982c-ca810d06ccec'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.627263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] MFA Rules not processed for user `1c06908726bd4abe9ae376c2d94faaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:38.630307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.700980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 905/1794] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:38.705507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.758584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] The token cache is being invalidate because project 24b17a800ad74e019d672d2155bab40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:38.759102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.762133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:38.767919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 890/1795] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:38 2022] DELETE /identity/v3/projects/24b17a800ad74e019d672d2155bab40b => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:38.771454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:38.773268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:38.805804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237af4-78ef-4ef7-b753-dc865bca4dcb None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.811238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.812033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.812322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.813095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.814032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.817001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.847737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54b672-6f17-45a5-982c-ca810d06ccec admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:38.853536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:38.854364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:38.854658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:38.854956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] PATH_INFO: `/v3/users/5ff55aece11c4278b8fa1aa5b8d8e038` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:38.856139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff55aece11c4278b8fa1aa5b8d8e038)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:38.858134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:38.997495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 906/1796] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:38 2022] POST /identity/v3/projects => generated 367 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:38.998453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.000425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.071486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53fe6-80a3-46ae-91e2-96d29c5c9c99 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.078370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.079229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.079521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.079805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.080458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.083044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.098734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff55aece11c4278b8fa1aa5b8d8e038'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.109690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff55aece11c4278b8fa1aa5b8d8e038'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.111226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff55aece11c4278b8fa1aa5b8d8e038'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.112047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff55aece11c4278b8fa1aa5b8d8e038'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.219969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-51bd918c-75a3-4bc7-9846-d941c23581cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff55aece11c4278b8fa1aa5b8d8e038'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.229859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 907/1797] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:38 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:39.229859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.245276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.245468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 891/1798] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:38 2022] DELETE /identity/v3/users/5ff55aece11c4278b8fa1aa5b8d8e038 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:39.245468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c575b-1aca-4299-8f52-63a66a6d02da None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.245468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c575b-1aca-4299-8f52-63a66a6d02da None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.245468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c575b-1aca-4299-8f52-63a66a6d02da None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.245776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09898d2-5a82-47ce-a994-d82601f14af3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.245857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 892/1799] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:39.245857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c575b-1aca-4299-8f52-63a66a6d02da None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.246685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ac6c575b-1aca-4299-8f52-63a66a6d02da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.320661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.321365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.321656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.321949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] PATH_INFO: `/v3/projects/08209ca932c845de843f839b8fbc58ae` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.323144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08209ca932c845de843f839b8fbc58ae)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.325172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.342391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c575b-1aca-4299-8f52-63a66a6d02da None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.349350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58574a3a-9ed5-4391-86cf-519844fe8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.357577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58574a3a-9ed5-4391-86cf-519844fe8ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.357577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58574a3a-9ed5-4391-86cf-519844fe8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.357577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58574a3a-9ed5-4391-86cf-519844fe8ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.357577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58574a3a-9ed5-4391-86cf-519844fe8ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.357577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58574a3a-9ed5-4391-86cf-519844fe8ea6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.370789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 893/1800] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:39.370789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.370789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.370789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.390432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:39.391680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.463361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 894/1801] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:39.465398 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.476235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2f90f-fee8-43b5-a51d-88a3020c51e8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.480889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.481598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.481884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.482168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] PATH_INFO: `/v3/projects/d1672d297e2e4dd784b15fada552a558/users/bc4f5d69dbc540e09a4a6f09da34f0ed/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.500425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1672d297e2e4dd784b15fada552a558, user_id=bc4f5d69dbc540e09a4a6f09da34f0ed, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.503206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.515393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08209ca932c845de843f839b8fbc58ae', 'request_id': 'req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.637116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08209ca932c845de843f839b8fbc58ae', 'request_id': 'req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.644621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08209ca932c845de843f839b8fbc58ae', 'request_id': 'req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.654958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 895/1802] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:39 2022] PUT /identity/v3/projects/d1672d297e2e4dd784b15fada552a558/users/bc4f5d69dbc540e09a4a6f09da34f0ed/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:39.655663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.659225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.659590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] The token cache is being invalidate because project 08209ca932c845de843f839b8fbc58ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:39.660362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.661559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:39.663654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 908/1803] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:39 2022] DELETE /identity/v3/projects/08209ca932c845de843f839b8fbc58ae => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:39.664733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.666415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.769437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9a9f-0b70-4e17-bd82-01250ca0ff47 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.778033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2be2d6-f982-4513-8ccc-3661feba5a05 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.782021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.782849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.783295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.784122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.785916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.798598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.800890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.811743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 896/1804] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:39.812865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.814288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.863812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.865585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.865585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.865868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.867582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.869708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.883508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 909/1805] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:39.883508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:39.883508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:39.892181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55202c-7341-45b3-9ae9-d6b644122d93 service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.896208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984628-fc40-4499-b360-aac7c435f2da admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:39.896944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.898259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.898544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.898825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] PATH_INFO: `/v3/users/995cbe9313fe46279a1898e057232ead` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.899994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=995cbe9313fe46279a1898e057232ead)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.901972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:39.902095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:39.902586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:39.902872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:39.903153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] PATH_INFO: `/v3/projects/23dab76730f240d0be527debf90a941d` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:39.904584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dab76730f240d0be527debf90a941d)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:39.906535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.127789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dab76730f240d0be527debf90a941d', 'request_id': 'req-789bfb1b-f5ed-485b-870e-1c11837e3d86'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.130667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995cbe9313fe46279a1898e057232ead'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.138046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995cbe9313fe46279a1898e057232ead'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.139362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995cbe9313fe46279a1898e057232ead'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.139893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995cbe9313fe46279a1898e057232ead'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.284573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dab76730f240d0be527debf90a941d', 'request_id': 'req-789bfb1b-f5ed-485b-870e-1c11837e3d86'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.292961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dab76730f240d0be527debf90a941d', 'request_id': 'req-789bfb1b-f5ed-485b-870e-1c11837e3d86'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.306178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] The token cache is being invalidate because project 23dab76730f240d0be527debf90a941d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:40.306178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.307196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.310304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 910/1806] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:39 2022] DELETE /identity/v3/projects/23dab76730f240d0be527debf90a941d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:40.311682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.318535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.396399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bfb1b-f5ed-485b-870e-1c11837e3d86 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.402112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8f47-d3ae-4bdb-97e6-c9418d80f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.402783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8f47-d3ae-4bdb-97e6-c9418d80f10f admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.403066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8f47-d3ae-4bdb-97e6-c9418d80f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.403350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8f47-d3ae-4bdb-97e6-c9418d80f10f admin admin] PATH_INFO: `/v3/projects/d1672d297e2e4dd784b15fada552a558/users/bc4f5d69dbc540e09a4a6f09da34f0ed/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.405276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b8f47-d3ae-4bdb-97e6-c9418d80f10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1672d297e2e4dd784b15fada552a558, user_id=bc4f5d69dbc540e09a4a6f09da34f0ed, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.407944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b8f47-d3ae-4bdb-97e6-c9418d80f10f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.419949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 911/1807] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:40 2022] PUT /identity/v3/projects/d1672d297e2e4dd784b15fada552a558/users/bc4f5d69dbc540e09a4a6f09da34f0ed/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:40.421122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9e4c9-2fc1-4c21-b232-c52298aee21a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.421423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9e4c9-2fc1-4c21-b232-c52298aee21a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.421706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9e4c9-2fc1-4c21-b232-c52298aee21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.448732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f8b9e4c9-2fc1-4c21-b232-c52298aee21a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:40.449905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f8b9e4c9-2fc1-4c21-b232-c52298aee21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.523881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 912/1808] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:40.525364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02347e21-42f5-4ca8-823f-31bd4946b74a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.525763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02347e21-42f5-4ca8-823f-31bd4946b74a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.526142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02347e21-42f5-4ca8-823f-31bd4946b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.556132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-02347e21-42f5-4ca8-823f-31bd4946b74a None None] MFA Rules not processed for user `bc4f5d69dbc540e09a4a6f09da34f0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:40.557423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-02347e21-42f5-4ca8-823f-31bd4946b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.649219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 913/1809] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:40.650662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.650956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.651241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.673396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:40.674620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.682859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995cbe9313fe46279a1898e057232ead'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:40.687441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 914/1810] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:40.687441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.687441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.693443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:40.711151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 897/1811] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:39 2022] DELETE /identity/v3/users/995cbe9313fe46279a1898e057232ead => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:40.716216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.716216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:40.760971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661606c6-7422-4998-aa3b-bc0a316f8459 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.787133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9aed-5805-4bf2-b5dc-c979ddc13a8c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.794202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.794756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.795182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.795548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.796536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:40.796950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.799340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.817332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 898/1812] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:40.819011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.827556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.827839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.828141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.828409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.831205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b658e-c61f-4336-8cd8-e9adb9741d7e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:40.838302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:40.838932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:40.839358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:40.839648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:40.840301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.842494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.883935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:40.903617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:40.905104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:40.916492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 915/1813] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:40.981545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 899/1814] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:40.984791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:40.998013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2dac8-9fe5-4cf1-b5ea-5bf41dee59d9 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.060060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.060708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.061023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.061297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.061934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.063872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.139756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.158575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 916/1815] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:40 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:41.159883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.176470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2015b0-f05d-494b-b400-34bbb72dfef7 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.180647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.181524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.181965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.182479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.183198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.184917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.200607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 917/1816] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:41.200893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee66a2-5672-4e68-9114-0df7dc4e07b6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.204194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.204825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.204962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.208545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.208545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.208545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.216559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3f1a2-ed4a-4138-a6d4-cc4f41ee2596 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.222418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.222880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.223166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.223445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.224253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.225842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.239044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 918/1817] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:41.239704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.243075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.257864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533f69-4f3a-494c-b0ad-9bc40171b33c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.263889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.264615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.265064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.265435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] PATH_INFO: `/v3/projects/0b9f729d6c3b4926b7ed5ba5cbdcb51c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.266819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9f729d6c3b4926b7ed5ba5cbdcb51c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.268885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.312007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.313533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.323980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 900/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:41.324801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.337235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c4f1-4f61-4ae3-b954-c7374b6e775f service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.342272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49e141-b76a-4a1d-aaef-cae32a532632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.355242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49e141-b76a-4a1d-aaef-cae32a532632 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.355242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49e141-b76a-4a1d-aaef-cae32a532632 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.355242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49e141-b76a-4a1d-aaef-cae32a532632 admin admin] PATH_INFO: `/v3/projects/5be1630d9dc04434a6127b055d12f48a/users/53b33e2c3de94b92b94ebd4c17b19594/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.360760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49e141-b76a-4a1d-aaef-cae32a532632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be1630d9dc04434a6127b055d12f48a, user_id=53b33e2c3de94b92b94ebd4c17b19594, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.363458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49e141-b76a-4a1d-aaef-cae32a532632 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.522161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 901/1819] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:41 2022] PUT /identity/v3/projects/5be1630d9dc04434a6127b055d12f48a/users/53b33e2c3de94b92b94ebd4c17b19594/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:41.528167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9f729d6c3b4926b7ed5ba5cbdcb51c', 'request_id': 'req-695445da-d14c-43f6-9cd4-23d1efce5246'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:41.533619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.533911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.534191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.563790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] MFA Rules not processed for user `53b33e2c3de94b92b94ebd4c17b19594`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:41.565058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.635572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 902/1820] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:41.640177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.696230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9f729d6c3b4926b7ed5ba5cbdcb51c', 'request_id': 'req-695445da-d14c-43f6-9cd4-23d1efce5246'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:41.706088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9f729d6c3b4926b7ed5ba5cbdcb51c', 'request_id': 'req-695445da-d14c-43f6-9cd4-23d1efce5246'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:41.723092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] The token cache is being invalidate because project 0b9f729d6c3b4926b7ed5ba5cbdcb51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:41.723460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:41.724865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-695445da-d14c-43f6-9cd4-23d1efce5246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:41.727833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 919/1821] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:41 2022] DELETE /identity/v3/projects/0b9f729d6c3b4926b7ed5ba5cbdcb51c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:41.729620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584ec5b-371a-4919-bd8d-68d0f86f4a3f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.733568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8e86-0334-436f-a492-7c634ad0e38f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.733935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8e86-0334-436f-a492-7c634ad0e38f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.734322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8e86-0334-436f-a492-7c634ad0e38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.736284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.737005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.737368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.737777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.738502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.741288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.759755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a2de8e86-0334-436f-a492-7c634ad0e38f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:41.761502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a2de8e86-0334-436f-a492-7c634ad0e38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.770328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 920/1822] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:41.784693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.785028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.785365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.805696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:41.807349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.819347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 921/1823] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:41.822560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.831727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b7697-7088-4441-a084-1bb0fb7dcb1c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.843015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.843729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.844018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.844298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.844986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:41.845298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.846974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.859821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 922/1824] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:41.866423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.875875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b95e3-78b2-45d2-9c81-b848fac05fee admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.880350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:41.880986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:41.881817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:41.882071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:41.883135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:41.885660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:41.912686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 903/1825] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:41.917691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:41.919386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:41.985514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd851-cfd3-4cd4-a190-e9c54fc424a0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:41.990580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 923/1826] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:41.991389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.052788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.053530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.053817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.054251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.054906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.056832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.062903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101b52c-8839-451e-9cdc-dc2421cd359d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.067934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.068680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.069743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.070538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.071035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.073511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.165707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 904/1827] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:42.179765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.180981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fe68-0646-49c4-9f45-e313b0c80edd admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.189423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.192908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.192908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.192908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.192908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.193255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.204825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 905/1828] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:42.208635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.218327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f694637-5bdb-4cd0-8216-2f53eaae2429 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.221647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 924/1829] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:41 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:42.223060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.223718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.224007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.224290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] PATH_INFO: `/v3/projects/3c19abc8c0a0402280a9c91bc1747f03/users/fa2c84f6fc4d4c84b97f31211190cf28/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.224432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.234370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520cc76-6915-451d-8172-93d3f8988d1d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.239577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.239994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c19abc8c0a0402280a9c91bc1747f03, user_id=fa2c84f6fc4d4c84b97f31211190cf28, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.240147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.240485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.241772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.242444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.243702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.244299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.254657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 925/1830] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:42.260109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.270338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f78d53-826c-4d40-b672-0a6edc8379a8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.277206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.278514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.278821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.279104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.279773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.281836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.295228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 926/1831] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:42.301999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.312840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383db09-5cd7-4e1f-8050-ef1f0a28c73d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.318046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e7caf-ac3b-4e35-b8ab-ee30c5cf9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.328391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e7caf-ac3b-4e35-b8ab-ee30c5cf9be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.328391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e7caf-ac3b-4e35-b8ab-ee30c5cf9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.328391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e7caf-ac3b-4e35-b8ab-ee30c5cf9be7 admin admin] PATH_INFO: `/v3/projects/f9a980efd0464df9aea3f34c9bdb133a/users/8a3b7637a6324d4b8c5ef200fd784eaa/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.336326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e7caf-ac3b-4e35-b8ab-ee30c5cf9be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a980efd0464df9aea3f34c9bdb133a, user_id=8a3b7637a6324d4b8c5ef200fd784eaa, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.339131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e7caf-ac3b-4e35-b8ab-ee30c5cf9be7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.394097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 906/1832] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:42 2022] PUT /identity/v3/projects/3c19abc8c0a0402280a9c91bc1747f03/users/fa2c84f6fc4d4c84b97f31211190cf28/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:42.398140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.463168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90999a-6353-43d8-9ad3-ed7b95f38239 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.468231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.468851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.469169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.469443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.470101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.471692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.485446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 907/1833] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:42.486504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.497164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174531f7-9f30-4a04-98c0-ba372e25a935 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.503394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37c281-208f-46ac-bb29-6d6cfd157fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.509131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37c281-208f-46ac-bb29-6d6cfd157fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.510746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37c281-208f-46ac-bb29-6d6cfd157fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.513989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 927/1834] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:42 2022] PUT /identity/v3/projects/f9a980efd0464df9aea3f34c9bdb133a/users/8a3b7637a6324d4b8c5ef200fd784eaa/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:42.514232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37c281-208f-46ac-bb29-6d6cfd157fa1 admin admin] PATH_INFO: `/v3/projects/3c19abc8c0a0402280a9c91bc1747f03/users/fa2c84f6fc4d4c84b97f31211190cf28/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.516596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37c281-208f-46ac-bb29-6d6cfd157fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c19abc8c0a0402280a9c91bc1747f03, user_id=fa2c84f6fc4d4c84b97f31211190cf28, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.519413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37c281-208f-46ac-bb29-6d6cfd157fa1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.524655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.524961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.525260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.536776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 908/1835] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:42 2022] PUT /identity/v3/projects/3c19abc8c0a0402280a9c91bc1747f03/users/fa2c84f6fc4d4c84b97f31211190cf28/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:42.547448 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.547868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.548166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.556925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] MFA Rules not processed for user `8a3b7637a6324d4b8c5ef200fd784eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:42.558301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:42.581133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] MFA Rules not processed for user `fa2c84f6fc4d4c84b97f31211190cf28`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:42.582424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:42.636503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 928/1836] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:42.644551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.668992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 909/1837] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:42.682081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.683709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:42.722954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5f129-9aba-42cb-885e-f266c631a356 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.729333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.730031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.730319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.730687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.731339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.733524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.757868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f78d5-53f0-45d5-8abe-f49108c0b9a2 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.762244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.762865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.763154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.763438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.765262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:42.826504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.827980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:42.837547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 910/1838] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:42.857193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 929/1839] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:42 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:42.859859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:42.872789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7b106-7290-43e1-9608-989e363a729d service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:42.958265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:42.958699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:42.958996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:42.959286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:42.960249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:42.971619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.118053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 911/1840] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:42 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:43.121994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.133277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9c7b-5b5f-4e07-88b3-5d4fb70cd89c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.138425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.139063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.139348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.139624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.140264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.141892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.153398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 930/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:43.157749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.168929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a35b0-d748-4fb9-8434-c40265abcc72 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.173692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.174381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.174670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.174948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] PATH_INFO: `/v3/projects/f56303141f1d4ddbb48e1c05dcbd67f0/users/c03679d4c90e4c88963ed5ffdbe644c7/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.190225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56303141f1d4ddbb48e1c05dcbd67f0, user_id=c03679d4c90e4c88963ed5ffdbe644c7, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.192878 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.312083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 912/1842] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:43 2022] PUT /identity/v3/projects/f56303141f1d4ddbb48e1c05dcbd67f0/users/c03679d4c90e4c88963ed5ffdbe644c7/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:43.316068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.331548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946618ad-7ffa-4905-9d02-c39cb72500a8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.391407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef74de-5a96-4eb7-b5d9-eb051f13e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.392034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef74de-5a96-4eb7-b5d9-eb051f13e47d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.392322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef74de-5a96-4eb7-b5d9-eb051f13e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.392604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef74de-5a96-4eb7-b5d9-eb051f13e47d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.393318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef74de-5a96-4eb7-b5d9-eb051f13e47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.394923 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef74de-5a96-4eb7-b5d9-eb051f13e47d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.405397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 931/1843] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:43.409860 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.420603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f487-87cb-4dd5-a143-dab3ffaaf65b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.425364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.426022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.426308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.426588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] PATH_INFO: `/v3/projects/f56303141f1d4ddbb48e1c05dcbd67f0/users/c03679d4c90e4c88963ed5ffdbe644c7/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.428758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56303141f1d4ddbb48e1c05dcbd67f0, user_id=c03679d4c90e4c88963ed5ffdbe644c7, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.431516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.441980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 913/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:43 2022] PUT /identity/v3/projects/f56303141f1d4ddbb48e1c05dcbd67f0/users/c03679d4c90e4c88963ed5ffdbe644c7/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:43.453857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.454155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.454442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.483088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] MFA Rules not processed for user `c03679d4c90e4c88963ed5ffdbe644c7`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:43.484288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:43.522715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:43.553845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 932/1845] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:43.569488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.573072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:43.640565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15b87-c03d-48f0-9d16-54ea36016fc4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.682099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551370e2-373d-4ecf-8c9c-a2c8dbf34347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.682099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551370e2-373d-4ecf-8c9c-a2c8dbf34347 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.682099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551370e2-373d-4ecf-8c9c-a2c8dbf34347 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.682099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551370e2-373d-4ecf-8c9c-a2c8dbf34347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.682744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551370e2-373d-4ecf-8c9c-a2c8dbf34347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.682744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551370e2-373d-4ecf-8c9c-a2c8dbf34347 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:43.682744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 914/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:43.852380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:43.929062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac92b-e9b8-4e47-9d96-d3dd62fd6c90 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:43.934525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:43.935171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:43.935458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:43.935741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] PATH_INFO: `/v3/users/8a3b7637a6324d4b8c5ef200fd784eaa` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:43.936872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3b7637a6324d4b8c5ef200fd784eaa)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:43.939095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:44.321883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3b7637a6324d4b8c5ef200fd784eaa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:44.322613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3b7637a6324d4b8c5ef200fd784eaa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:44.330364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3b7637a6324d4b8c5ef200fd784eaa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:44.430467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3b7637a6324d4b8c5ef200fd784eaa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:44.443358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3b7637a6324d4b8c5ef200fd784eaa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:44.450902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 933/1847] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:43 2022] DELETE /identity/v3/users/8a3b7637a6324d4b8c5ef200fd784eaa => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:44.455584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:44.456066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:44.456159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:44.477596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:44.478996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:44.557568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 915/1848] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:44.573102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:44.574538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:44.636157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17967-9c16-4c03-bb33-e733c1b557db admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:44.639927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:44.640546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:44.641099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:44.641364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:44.652917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:44.660114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:44.666467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 934/1849] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:44.860188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:45.140861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:45.148634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:45.158910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839568b1-fbdd-462d-b987-d2abcb4c9fc8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:45.164490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:45.165421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:45.167603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:45.168396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] PATH_INFO: `/v3/projects/f9a980efd0464df9aea3f34c9bdb133a` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:45.170492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a980efd0464df9aea3f34c9bdb133a)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:45.172351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:45.315702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a980efd0464df9aea3f34c9bdb133a', 'request_id': 'req-764d5977-abf1-43a9-ac6c-b1b06f242757'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.322408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a980efd0464df9aea3f34c9bdb133a', 'request_id': 'req-764d5977-abf1-43a9-ac6c-b1b06f242757'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.328639 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a980efd0464df9aea3f34c9bdb133a', 'request_id': 'req-764d5977-abf1-43a9-ac6c-b1b06f242757'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.470797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] The token cache is being invalidate because project f9a980efd0464df9aea3f34c9bdb133a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:45.471464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.471796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.473368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 916/1850] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:45 2022] DELETE /identity/v3/projects/f9a980efd0464df9aea3f34c9bdb133a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:45.478258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:45.487906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86d12f-8497-4914-aea6-c9477c01ecce service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:45.594327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:45.595690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:45.596773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:45.597750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] PATH_INFO: `/v3/users/c03679d4c90e4c88963ed5ffdbe644c7` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:45.599462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03679d4c90e4c88963ed5ffdbe644c7)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:45.602750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:45.872277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03679d4c90e4c88963ed5ffdbe644c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.872995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03679d4c90e4c88963ed5ffdbe644c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.881224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03679d4c90e4c88963ed5ffdbe644c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:45.992024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03679d4c90e4c88963ed5ffdbe644c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:46.007571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03679d4c90e4c88963ed5ffdbe644c7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:46.016977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 935/1851] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:45 2022] DELETE /identity/v3/users/c03679d4c90e4c88963ed5ffdbe644c7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:46.611961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:46.613821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:46.629366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5977-abf1-43a9-ac6c-b1b06f242757 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:46.748181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:46.750571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:46.776962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:46.778104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:46.781334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:46.781334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] PATH_INFO: `/v3/projects/f56303141f1d4ddbb48e1c05dcbd67f0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:46.782054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56303141f1d4ddbb48e1c05dcbd67f0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:46.786495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:46.904892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0436e2-a9ad-47af-a515-333e20c98dd3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:46.908597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:46.909382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:46.909751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:46.909948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:46.913235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:46.982062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:46.983723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaacbdb-18a3-4cf8-bdd7-7cdc0081cc53 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:46.995498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 936/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:46.996978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b500e1-a8cb-45e6-9d07-8d2eff9af313 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:46.997424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b500e1-a8cb-45e6-9d07-8d2eff9af313 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:46.997713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b500e1-a8cb-45e6-9d07-8d2eff9af313 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:46.999003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 937/1853] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:14:47.009386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.009741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.010342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.025824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56303141f1d4ddbb48e1c05dcbd67f0', 'request_id': 'req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:47.035365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56303141f1d4ddbb48e1c05dcbd67f0', 'request_id': 'req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:47.036803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:47.039795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:47.046758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56303141f1d4ddbb48e1c05dcbd67f0', 'request_id': 'req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:47.129354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 938/1854] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:47.136227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.137709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:47.152675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5fc1a-843b-4b67-ae03-125ece92bbf4 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.159871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b48d1-0e32-4bc4-ad78-8bc697be49a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.160579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b48d1-0e32-4bc4-ad78-8bc697be49a8 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.161027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b48d1-0e32-4bc4-ad78-8bc697be49a8 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.161311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b48d1-0e32-4bc4-ad78-8bc697be49a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.169157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] The token cache is being invalidate because project f56303141f1d4ddbb48e1c05dcbd67f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:47.169157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:47.169157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90d6b51c-b3bd-4ee0-9fe6-15b05d3da64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:47.169157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 917/1855] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:46 2022] DELETE /identity/v3/projects/f56303141f1d4ddbb48e1c05dcbd67f0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:47.172202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.172724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.173247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.174192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b48d1-0e32-4bc4-ad78-8bc697be49a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.179469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b48d1-0e32-4bc4-ad78-8bc697be49a8 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.191207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 939/1856] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:47.203603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:47.203603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:47.204478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:47.284287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 918/1857] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:47.292254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.292538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.292929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.322248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:47.323570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:47.344983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 940/1858] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:47.348568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.368250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:47.368250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696c8ba-833f-4308-9d11-4e0389bf77a3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.371088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.371713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.372016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.372295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.372971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:47.373285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.374888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.388023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 919/1859] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:14:47.392385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.402314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef89f-89ae-40eb-9329-2d6c761a1406 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.407061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.409979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.409979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.409979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.409979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.410754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.517360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 941/1860] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:47.527596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.538823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2e08b-27a9-4bd8-9328-645aa3b4b634 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.602312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.602935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.603224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.603502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.604147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.606110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.738945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 920/1861] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:47.739486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.749793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883d777-332c-441a-aa31-c1335ea5173a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.754454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.755072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.755358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.755641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.762727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.762727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.772474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 942/1862] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:47.773534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.783414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8ff0-75d2-4ef3-b6af-418efcf38e56 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.788821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804ccb4-dd18-4f3f-a21c-01c2dfcb1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.789415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804ccb4-dd18-4f3f-a21c-01c2dfcb1695 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.789697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804ccb4-dd18-4f3f-a21c-01c2dfcb1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.789976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804ccb4-dd18-4f3f-a21c-01c2dfcb1695 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.790647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804ccb4-dd18-4f3f-a21c-01c2dfcb1695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.792291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804ccb4-dd18-4f3f-a21c-01c2dfcb1695 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.805444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 921/1863] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:47.812203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:47.823038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f846938-fc66-423c-8d58-7c829f4edad4 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:47.827891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:47.828549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.828832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.829164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] PATH_INFO: `/v3/projects/a58f0f39ae3c4d049675d7c0e3c2492a/users/b4fa4baadf224aabb150b7600a317ed7/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.844434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58f0f39ae3c4d049675d7c0e3c2492a, user_id=b4fa4baadf224aabb150b7600a317ed7, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:47.847110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:47.957311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 943/1864] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:47 2022] PUT /identity/v3/projects/a58f0f39ae3c4d049675d7c0e3c2492a/users/b4fa4baadf224aabb150b7600a317ed7/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:47.968193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:47.968501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:47.968782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:47.999342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] MFA Rules not processed for user `b4fa4baadf224aabb150b7600a317ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:48.000665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:48.094412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 922/1865] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:48.098727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:48.180497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6f59-eb0f-4bd3-b69a-6da1b20f9f0e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:48.185807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:48.186424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.190489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.190489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.190489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:48.190489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:48.351938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:48.354006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:48.370131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83401b-dd3f-424b-a611-dd62a3612fce None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:48.378120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 944/1866] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:48 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:48.382832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:48.382832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.382832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.382832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] PATH_INFO: `/v3/users/40b64e5fc56f46628bb96f9943695c61` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.383407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b64e5fc56f46628bb96f9943695c61)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:48.385873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:48.391743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:48.477062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ede71-b34c-445f-9d14-ab680eca0a98 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:48.492795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:48.492795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.492795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.492795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.500215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:48.500215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:48.654314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 945/1867] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:48 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:48.657797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:48.668317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a27e2-55ee-4a87-9cc9-16b9ecf1f5f0 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:48.673354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:48.673967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.674259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.674598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.675209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:48.676829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:48.689749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 946/1868] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:48.692698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:48.697821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b64e5fc56f46628bb96f9943695c61'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:48.707051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b64e5fc56f46628bb96f9943695c61'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:48.707914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0698-8d3c-4919-b542-6c5cd03c3d2d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:48.708828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b64e5fc56f46628bb96f9943695c61'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:48.710323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b64e5fc56f46628bb96f9943695c61'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:48.717503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:48.723653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.723653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.723653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] PATH_INFO: `/v3/projects/0d9ac641f8a640c2b3aba799688262f4/users/cc948b633f9e46a9bf28e3587f7f403e/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.737453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9ac641f8a640c2b3aba799688262f4, user_id=cc948b633f9e46a9bf28e3587f7f403e, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:48.741140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:48.825713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-088af234-eb9c-4a55-b905-1e8000d0d4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b64e5fc56f46628bb96f9943695c61'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:48.862640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 923/1869] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:48 2022] DELETE /identity/v3/users/40b64e5fc56f46628bb96f9943695c61 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:48.867203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 947/1870] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:48 2022] PUT /identity/v3/projects/0d9ac641f8a640c2b3aba799688262f4/users/cc948b633f9e46a9bf28e3587f7f403e/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:48.868267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:48.868416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:48.868890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:48.870751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:48.870889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:48.893975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:48.895310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:48.962491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7fdef-17d1-4d4c-8ae5-93d60673dff3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:49.018008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 924/1871] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:49.025856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:49.027534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:49.055142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:49.056091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:49.057018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:49.057486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:49.059098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:49.061641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:49.073913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 948/1872] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:49.083715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:49.096882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50125d-ef08-4fa7-95d6-48e3a005347c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:49.101337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d342e73-7483-4e02-838b-42ee2e3956cf None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:49.102829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a4acd-5ef2-4c20-9269-fc34601a318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:49.103818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a4acd-5ef2-4c20-9269-fc34601a318a admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:49.104015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a4acd-5ef2-4c20-9269-fc34601a318a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:49.104298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a4acd-5ef2-4c20-9269-fc34601a318a admin admin] PATH_INFO: `/v3/projects/0d9ac641f8a640c2b3aba799688262f4/users/cc948b633f9e46a9bf28e3587f7f403e/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:49.105885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:49.106709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:49.107150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:49.107253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a4acd-5ef2-4c20-9269-fc34601a318a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9ac641f8a640c2b3aba799688262f4, user_id=cc948b633f9e46a9bf28e3587f7f403e, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:49.110146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a4acd-5ef2-4c20-9269-fc34601a318a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:49.117722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:49.123753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 949/1873] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:49 2022] PUT /identity/v3/projects/0d9ac641f8a640c2b3aba799688262f4/users/cc948b633f9e46a9bf28e3587f7f403e/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:49.140840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:49.141511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:49.142640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:49.164990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:49.166523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:49.197539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 925/1874] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:49.219971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] MFA Rules not processed for user `cc948b633f9e46a9bf28e3587f7f403e`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:49.221508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:49.327144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 950/1875] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:49.342169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:49.344017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:49.480549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68513a-08c9-4816-91a8-f1a217039609 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:49.599403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:49.600551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:49.601391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:49.602337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:49.613382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:49.615133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:49.630379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 926/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:50.141577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:50.143787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:50.256888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:50.258921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:50.281631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ffcfa-9067-4c4d-94f6-ec99fcf014d5 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:50.285608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb155-fe07-4901-911c-ecf0e35ddf42 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:50.292742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:50.293592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:50.293881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:50.295030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] PATH_INFO: `/v3/users/1c06908726bd4abe9ae376c2d94faaf7` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:50.295140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:50.295140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:50.295318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:50.295619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c06908726bd4abe9ae376c2d94faaf7)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:50.295989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] PATH_INFO: `/v3/projects/a13ad7b0bce84fe1a39f1d58279e085d` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:50.297853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:50.298653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13ad7b0bce84fe1a39f1d58279e085d)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:50.300769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:50.609292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c06908726bd4abe9ae376c2d94faaf7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.609510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13ad7b0bce84fe1a39f1d58279e085d', 'request_id': 'req-a80d7f25-5169-4bfd-8f5d-835a737c281a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.619688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c06908726bd4abe9ae376c2d94faaf7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.620859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c06908726bd4abe9ae376c2d94faaf7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.621681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c06908726bd4abe9ae376c2d94faaf7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.738256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13ad7b0bce84fe1a39f1d58279e085d', 'request_id': 'req-a80d7f25-5169-4bfd-8f5d-835a737c281a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.746147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13ad7b0bce84fe1a39f1d58279e085d', 'request_id': 'req-a80d7f25-5169-4bfd-8f5d-835a737c281a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.770014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] The token cache is being invalidate because project a13ad7b0bce84fe1a39f1d58279e085d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:50.770670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.774525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.776732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 951/1877] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:50 2022] DELETE /identity/v3/projects/a13ad7b0bce84fe1a39f1d58279e085d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:50.782148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:50.789171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:50.848775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0b658524-5d81-4d87-a803-3d2416ef121c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c06908726bd4abe9ae376c2d94faaf7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:50.931075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 927/1878] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:50 2022] DELETE /identity/v3/users/1c06908726bd4abe9ae376c2d94faaf7 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:50.937560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:50.942440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:50.942734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:51.013958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7f25-5169-4bfd-8f5d-835a737c281a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:51.024147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:51.029169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:51.201803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:51.205675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:51.205970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:51.210904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] PATH_INFO: `/v3/users/7b6d379915d248feb6c11a22f6cae4a5` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:51.214190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6d379915d248feb6c11a22f6cae4a5)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:51.216339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:51.231030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 928/1879] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:51.293609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:51.297224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:51.385531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7030700-46c3-445e-9044-94c673db4a22 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:51.390883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:51.391547 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:51.391949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:51.392464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:51.406912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:51.409083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:51.423922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 929/1880] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:51.499561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6d379915d248feb6c11a22f6cae4a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:51.505093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6d379915d248feb6c11a22f6cae4a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:51.550642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6d379915d248feb6c11a22f6cae4a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:51.686995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6d379915d248feb6c11a22f6cae4a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:51.704471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6c9ccede-87e0-4b63-9fb2-ef1cce407a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6d379915d248feb6c11a22f6cae4a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:51.714235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 952/1881] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:50 2022] DELETE /identity/v3/users/7b6d379915d248feb6c11a22f6cae4a5 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:51.746690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:51.748144 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:51.764005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a1b2-1fef-42a9-ba66-2d883ba97c03 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:51.888429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:51.889424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:51.890245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:51.890738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] PATH_INFO: `/v3/users/b4fa4baadf224aabb150b7600a317ed7` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:51.892564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fa4baadf224aabb150b7600a317ed7)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:51.896044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:52.184351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fa4baadf224aabb150b7600a317ed7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.195144 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fa4baadf224aabb150b7600a317ed7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.197894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fa4baadf224aabb150b7600a317ed7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.199652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fa4baadf224aabb150b7600a317ed7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.310575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fa4baadf224aabb150b7600a317ed7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.330583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 930/1882] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:51 2022] DELETE /identity/v3/users/b4fa4baadf224aabb150b7600a317ed7 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:52.335814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:52.336362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:52.336539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:52.357444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:52.359318 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:52.374634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:52.378508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:52.504886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 953/1883] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:52.525333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:52.526978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:52.553514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b245a-fb97-4523-8ff7-9530a03a2a37 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:52.565020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:52.565974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:52.566494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:52.571139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] PATH_INFO: `/v3/projects/bcefefd3382348d08dcaaa471a2d3000` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:52.571729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcefefd3382348d08dcaaa471a2d3000)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:52.580242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:52.622880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8515-df62-46b0-a3b4-bdb4050c8acb None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:52.633749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:52.635243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:52.636430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:52.641820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:52.667832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:52.669758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:52.684112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 954/1884] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:52.758456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:52.864807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcefefd3382348d08dcaaa471a2d3000', 'request_id': 'req-9c83cfa4-765d-4911-9180-db8bbaa40579'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.869973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:52.872447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:52.878054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:52.886432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcefefd3382348d08dcaaa471a2d3000', 'request_id': 'req-9c83cfa4-765d-4911-9180-db8bbaa40579'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.888303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcefefd3382348d08dcaaa471a2d3000', 'request_id': 'req-9c83cfa4-765d-4911-9180-db8bbaa40579'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.927367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1834-240d-4d40-9d71-6c8c205b768d service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:52.993804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] The token cache is being invalidate because project bcefefd3382348d08dcaaa471a2d3000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:52.994249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.995118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:52.999074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 931/1885] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:52 2022] DELETE /identity/v3/projects/bcefefd3382348d08dcaaa471a2d3000 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:53.003031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:53.009076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:53.047523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:53.048909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.049429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.051546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] PATH_INFO: `/v3/projects/660a919ca2004c6bb8bf698bb8667cc2` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.054934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=660a919ca2004c6bb8bf698bb8667cc2)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:53.058097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:53.126425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83cfa4-765d-4911-9180-db8bbaa40579 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:53.139453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:53.140293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.140644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.141084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] PATH_INFO: `/v3/users/bc4f5d69dbc540e09a4a6f09da34f0ed` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.142351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4f5d69dbc540e09a4a6f09da34f0ed)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:53.144820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:53.246813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660a919ca2004c6bb8bf698bb8667cc2', 'request_id': 'req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.412295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660a919ca2004c6bb8bf698bb8667cc2', 'request_id': 'req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.419446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660a919ca2004c6bb8bf698bb8667cc2', 'request_id': 'req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.434571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] The token cache is being invalidate because project 660a919ca2004c6bb8bf698bb8667cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:53.436154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.438442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cc4edb2f-0d61-49eb-9af1-d49378ea97ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.440112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 955/1886] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:52 2022] DELETE /identity/v3/projects/660a919ca2004c6bb8bf698bb8667cc2 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:53.448306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.448667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.449170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.468511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:53.470231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:53.493891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4f5d69dbc540e09a4a6f09da34f0ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.507774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4f5d69dbc540e09a4a6f09da34f0ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.509054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4f5d69dbc540e09a4a6f09da34f0ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.510399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4f5d69dbc540e09a4a6f09da34f0ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.543523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 956/1887] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:53.544618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:53.546456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:53.561430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e5dbe-234a-42e1-9521-c07df8007844 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:53.565157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:53.566245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.566245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.566417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] PATH_INFO: `/v3/projects/a58f0f39ae3c4d049675d7c0e3c2492a` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.567613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58f0f39ae3c4d049675d7c0e3c2492a)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:53.570580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:53.636124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6f4656b3-a213-4df0-891f-48ba9a20004c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4f5d69dbc540e09a4a6f09da34f0ed'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.654064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 932/1888] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:53 2022] DELETE /identity/v3/users/bc4f5d69dbc540e09a4a6f09da34f0ed => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:53.655372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.655664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.655944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.675904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:53.677162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:53.755516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58f0f39ae3c4d049675d7c0e3c2492a', 'request_id': 'req-7bb7611b-025c-4be1-b4c0-1e0d361744fa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.756573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 933/1889] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:53.758119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:53.772989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451794c-fd9d-4cb4-8893-1696a62bd0e8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:53.843734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:53.844339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.844628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.844977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.845638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:53.846141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:53.847918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:53.871290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 934/1890] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:53.872651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:53.883198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707760fd-45fb-4e8b-a9dd-1bd502c9e995 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:53.888166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:53.888867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.889304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.889654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.890309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:53.897157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:53.897518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58f0f39ae3c4d049675d7c0e3c2492a', 'request_id': 'req-7bb7611b-025c-4be1-b4c0-1e0d361744fa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.906900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58f0f39ae3c4d049675d7c0e3c2492a', 'request_id': 'req-7bb7611b-025c-4be1-b4c0-1e0d361744fa'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.925673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] The token cache is being invalidate because project a58f0f39ae3c4d049675d7c0e3c2492a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:53.926267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.927124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:53.933160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 957/1891] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:53 2022] DELETE /identity/v3/projects/a58f0f39ae3c4d049675d7c0e3c2492a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:53.934659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:53.936408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:53.953814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7611b-025c-4be1-b4c0-1e0d361744fa admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:53.957587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:53.958353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:53.958709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:53.959164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] PATH_INFO: `/v3/users/cc948b633f9e46a9bf28e3587f7f403e` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:53.960174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc948b633f9e46a9bf28e3587f7f403e)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:53.962285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.085560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 935/1892] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:53 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:54.090399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.092980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.175664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68605a55-d327-4024-950d-738cdd16e8ec admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:54.181468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:54.182207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.182557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.183866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.183866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:54.185875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.299852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 936/1893] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:54 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:54.300852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.313205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f5cd-9029-43c4-aee6-57008d6e39f8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:54.317353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc948b633f9e46a9bf28e3587f7f403e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.318054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc948b633f9e46a9bf28e3587f7f403e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.323080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:54.323831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.324215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.324968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.325836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:54.327429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc948b633f9e46a9bf28e3587f7f403e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.328041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.345033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 937/1894] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:54.346321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.348551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.373862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d125c-9ef0-4954-b9cd-f2b546ecac1d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:54.378988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:54.379629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.379914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.380197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] PATH_INFO: `/v3/projects/d1672d297e2e4dd784b15fada552a558` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.381690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1672d297e2e4dd784b15fada552a558)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:54.388009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.447784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc948b633f9e46a9bf28e3587f7f403e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.462161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc948b633f9e46a9bf28e3587f7f403e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.468144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 958/1895] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:53 2022] DELETE /identity/v3/users/cc948b633f9e46a9bf28e3587f7f403e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:54.471181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.471181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.585385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1c121-132c-44cf-81d6-25d01114c9aa admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:54.602915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1672d297e2e4dd784b15fada552a558', 'request_id': 'req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.614335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1672d297e2e4dd784b15fada552a558', 'request_id': 'req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.626232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1672d297e2e4dd784b15fada552a558', 'request_id': 'req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.659349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:54.659981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.660267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.660549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.661242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:54.663702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.678008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 959/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:54.679436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.689894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc516c-6c56-46f5-a1a2-f48c086676cc admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:54.696031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298d372-a2d3-4785-ab87-26e076c112dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:54.696853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298d372-a2d3-4785-ab87-26e076c112dd admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.697177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298d372-a2d3-4785-ab87-26e076c112dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.697459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298d372-a2d3-4785-ab87-26e076c112dd admin admin] PATH_INFO: `/v3/projects/0f6f8b6e166040c1a95ba30d0cf11681/users/292d268aca83434d9b70e3a6b65090be/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.714165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298d372-a2d3-4785-ab87-26e076c112dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6f8b6e166040c1a95ba30d0cf11681, user_id=292d268aca83434d9b70e3a6b65090be, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:54.717080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298d372-a2d3-4785-ab87-26e076c112dd admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.761706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] The token cache is being invalidate because project d1672d297e2e4dd784b15fada552a558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:54.762147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.762832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4e896fff-2fcc-4b4a-83c9-b22b7b05b4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:54.764493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 938/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:54 2022] DELETE /identity/v3/projects/d1672d297e2e4dd784b15fada552a558 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:54.769513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c515-0efe-4e7c-a40d-5ffbe5342a77 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.769858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c515-0efe-4e7c-a40d-5ffbe5342a77 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.770139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c515-0efe-4e7c-a40d-5ffbe5342a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.792956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-3ce2c515-0efe-4e7c-a40d-5ffbe5342a77 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:54.797250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3ce2c515-0efe-4e7c-a40d-5ffbe5342a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.803681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 939/1898] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:54.821628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.821628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.821628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.838733 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:54.840191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.848433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 940/1899] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:54.853451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.862687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 960/1900] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:54 2022] PUT /identity/v3/projects/0f6f8b6e166040c1a95ba30d0cf11681/users/292d268aca83434d9b70e3a6b65090be/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:54.866944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519a9d-efb7-4e45-9ba4-b8ba743e136f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:54.873236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.873521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.873798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.904658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] MFA Rules not processed for user `292d268aca83434d9b70e3a6b65090be`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:54.905931 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.961907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:54.962652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:54.963005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:54.963351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:54.964058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:54.964427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:54.966233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:54.976659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 961/1901] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:54.982521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 941/1902] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:54.988267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.988366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:54.989335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:54.998519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289383ac-c6bf-4062-a2ea-799f898fe276 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.003166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.003846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.004203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.004566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.005251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.007751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.054734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020139c4-cc99-451c-9715-e00fa71016f0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.058607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.059164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.059445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.059722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.069613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.071375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.081752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 942/1903] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:55.082660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.084350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.106528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 962/1904] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:54 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:55.107302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.107963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132d61c-abe0-4c3d-b55b-a9d45f152885 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.110487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.166624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.167486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.167692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.167964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] PATH_INFO: `/v3/projects/0d9ac641f8a640c2b3aba799688262f4` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.169363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9ac641f8a640c2b3aba799688262f4)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.171343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.178769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9983-97a7-4065-a047-7cc1883a42ad admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.183547 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.184198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.184483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.185085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] PATH_INFO: `/v3/users/292d268aca83434d9b70e3a6b65090be` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.185957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=292d268aca83434d9b70e3a6b65090be)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.187904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.399187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292d268aca83434d9b70e3a6b65090be'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.399376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9ac641f8a640c2b3aba799688262f4', 'request_id': 'req-01689ddf-8c14-4e85-82f5-033af3c85d22'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.399983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292d268aca83434d9b70e3a6b65090be'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.406654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9ac641f8a640c2b3aba799688262f4', 'request_id': 'req-01689ddf-8c14-4e85-82f5-033af3c85d22'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.408106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292d268aca83434d9b70e3a6b65090be'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.414477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9ac641f8a640c2b3aba799688262f4', 'request_id': 'req-01689ddf-8c14-4e85-82f5-033af3c85d22'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.516292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292d268aca83434d9b70e3a6b65090be'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.529805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292d268aca83434d9b70e3a6b65090be'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.536037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 963/1905] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:55 2022] DELETE /identity/v3/users/292d268aca83434d9b70e3a6b65090be => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:55.536755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.541962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.605980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ae8d6-d43b-4313-91f3-fb5ca762e3ca admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.610961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb714-a15f-4c39-8cc3-3ce5ded7beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.611566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb714-a15f-4c39-8cc3-3ce5ded7beb3 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.611848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb714-a15f-4c39-8cc3-3ce5ded7beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.612167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb714-a15f-4c39-8cc3-3ce5ded7beb3 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.612796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb714-a15f-4c39-8cc3-3ce5ded7beb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.613207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] The token cache is being invalidate because project 0d9ac641f8a640c2b3aba799688262f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:55.613655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.614280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-01689ddf-8c14-4e85-82f5-033af3c85d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:55.614739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb714-a15f-4c39-8cc3-3ce5ded7beb3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.616894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 943/1906] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:55 2022] DELETE /identity/v3/projects/0d9ac641f8a640c2b3aba799688262f4 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:55.619228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb03b1-bea9-451a-950d-b4b55b332d86 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.619522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb03b1-bea9-451a-950d-b4b55b332d86 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.619809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb03b1-bea9-451a-950d-b4b55b332d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.639711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e3bb03b1-bea9-451a-950d-b4b55b332d86 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:55.640919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e3bb03b1-bea9-451a-950d-b4b55b332d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.649197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 944/1907] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:55.650530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.650825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.651109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.672201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:55.673449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.681459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 945/1908] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:55.682312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.683539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.699967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 964/1909] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:55 2022] POST /identity/v3/users => generated 280 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:55.701553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d6213-f332-4710-a750-5a5d49156618 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.701846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d6213-f332-4710-a750-5a5d49156618 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.702126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d6213-f332-4710-a750-5a5d49156618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.721766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-991d6213-f332-4710-a750-5a5d49156618 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:55.722976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-991d6213-f332-4710-a750-5a5d49156618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.731984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 965/1910] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:55.732823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d6213-f332-4710-a750-5a5d49156618 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.734127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-991d6213-f332-4710-a750-5a5d49156618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:55.745463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d6213-f332-4710-a750-5a5d49156618 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.746535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007934-3e19-4d1c-aa7e-bdccfd9dd852 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.750005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.750184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.750602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.750790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.750880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.751076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.751173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.751353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.751772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.753418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.761606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.763036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.764196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 966/1911] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:55.765054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.774245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 946/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:55.774938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.776491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dced99c-853b-4329-83ec-33e819dbc27f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.782088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.784034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.784034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.784034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.784321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:55.784402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.786174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.788221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94d752-869a-4705-a722-1065ccb208b0 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.794976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.795784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.796072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.796350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.797236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.799075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.801994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 967/1913] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:55.806200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.815554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 947/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:55.817163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e24de-6454-48f6-a2b6-412ccebda607 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.820316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.824186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.824816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.825212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.825493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.826252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.828442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.832918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fe591-7d4b-4645-8bc9-0d378c6aa9ac admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:55.839459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f05b5-4883-416a-bd09-2a6ef0fa55db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:55.840570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f05b5-4883-416a-bd09-2a6ef0fa55db admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:55.840864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f05b5-4883-416a-bd09-2a6ef0fa55db admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:55.841216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f05b5-4883-416a-bd09-2a6ef0fa55db admin admin] PATH_INFO: `/v3/projects/50fb329d76c940e58a282926bdc4e03a/users/41dab2d307734b6887fb95e43d6a63da/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:55.860722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f05b5-4883-416a-bd09-2a6ef0fa55db admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fb329d76c940e58a282926bdc4e03a, user_id=41dab2d307734b6887fb95e43d6a63da, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:55.863946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f05b5-4883-416a-bd09-2a6ef0fa55db admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:55.960734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 968/1915] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:55 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:55.963467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:55.992530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 948/1916] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:55 2022] PUT /identity/v3/projects/50fb329d76c940e58a282926bdc4e03a/users/41dab2d307734b6887fb95e43d6a63da/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:56.010789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.013658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.015845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.039087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918008b-9e39-4d42-be8e-47def95678e6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.067336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] MFA Rules not processed for user `41dab2d307734b6887fb95e43d6a63da`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:56.069732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:56.115437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:56.163200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.164666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.165064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.166068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.166867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.169635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.197236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 949/1917] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:56.232040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:56.234068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:56.314329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 969/1918] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:55 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:56.324320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:56.329732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2f401-6cf9-4ac1-935f-0c754f558e3a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.334744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.335384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.335708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.335998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.347306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:56.347503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706823a-5916-42a7-ade9-825decfd3096 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.349946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.351994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.353950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.355416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.356067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.356362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.357068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.361324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.385127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 970/1919] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:56.385127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:56.385939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 950/1920] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:14:56.388269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:56.393468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873926e-41b9-4a58-bf57-7ffafeac1fec admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.399322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.399979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.400269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.412510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72867062-51e3-44a7-8da4-41772611789d service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.412691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.412691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.412691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.412879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.412879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.412879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.412879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] PATH_INFO: `/v3/users/41dab2d307734b6887fb95e43d6a63da` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.413172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dab2d307734b6887fb95e43d6a63da)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.413172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.416983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 971/1921] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:56.419632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:56.429899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b1621-04a9-49d3-b95e-8d8fc5e11542 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.434523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.435172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.435455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.435732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] PATH_INFO: `/v3/projects/b4cf43beaf9343e684109cbeeaaf5d70/users/2fcdf042bb42406397415efb7d2ecdb4/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.455705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4cf43beaf9343e684109cbeeaaf5d70, user_id=2fcdf042bb42406397415efb7d2ecdb4, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.458417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.585958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 972/1922] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:56 2022] PUT /identity/v3/projects/b4cf43beaf9343e684109cbeeaaf5d70/users/2fcdf042bb42406397415efb7d2ecdb4/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:56.588043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:56.598702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:56.675198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff01da8-7d5f-441d-b1b6-5cb52e44fcfc admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:56.686142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:56.689978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.689978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.689978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] PATH_INFO: `/v3/projects/0f6f8b6e166040c1a95ba30d0cf11681` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.690992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6f8b6e166040c1a95ba30d0cf11681)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:56.693747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:56.698260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dab2d307734b6887fb95e43d6a63da'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.751836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dab2d307734b6887fb95e43d6a63da'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.754479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dab2d307734b6887fb95e43d6a63da'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.755112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dab2d307734b6887fb95e43d6a63da'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.860009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f38a30a7-1d4e-4c96-9fe4-e047246e016d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dab2d307734b6887fb95e43d6a63da'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.883180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6f8b6e166040c1a95ba30d0cf11681', 'request_id': 'req-475262b3-4882-4afc-a32f-d4803b2bb331'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.889541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 951/1923] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:14:56 2022] DELETE /identity/v3/users/41dab2d307734b6887fb95e43d6a63da => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:56.891674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007ce4-6321-4ead-8290-c607465378ae None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:56.891972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007ce4-6321-4ead-8290-c607465378ae None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:56.892258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007ce4-6321-4ead-8290-c607465378ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:56.928011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d1007ce4-6321-4ead-8290-c607465378ae None None] MFA Rules not processed for user `2fcdf042bb42406397415efb7d2ecdb4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:56.928011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d1007ce4-6321-4ead-8290-c607465378ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:56.973165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6f8b6e166040c1a95ba30d0cf11681', 'request_id': 'req-475262b3-4882-4afc-a32f-d4803b2bb331'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.981524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6f8b6e166040c1a95ba30d0cf11681', 'request_id': 'req-475262b3-4882-4afc-a32f-d4803b2bb331'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:56.993198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] The token cache is being invalidate because project 0f6f8b6e166040c1a95ba30d0cf11681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:56.993501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:57.000531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-475262b3-4882-4afc-a32f-d4803b2bb331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:57.002142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 973/1924] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:56 2022] DELETE /identity/v3/projects/0f6f8b6e166040c1a95ba30d0cf11681 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:57.003341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.003627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.003913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.018518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 952/1925] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:57.019853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.020146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.020428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.027081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:57.028322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.041224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:57.042466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.089279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 974/1926] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:57.090223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.091638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.104118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddccd8-fcd8-42a1-8956-4a33f20ec25a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.109332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13362-e95c-41fe-9ced-0a9ca27da9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.110282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13362-e95c-41fe-9ced-0a9ca27da9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.110381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13362-e95c-41fe-9ced-0a9ca27da9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.110681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13362-e95c-41fe-9ced-0a9ca27da9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.111163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 953/1927] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:57.111329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a13362-e95c-41fe-9ced-0a9ca27da9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.112178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.113359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a13362-e95c-41fe-9ced-0a9ca27da9c9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.113564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.172371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d146-e5e8-400b-9370-244d97a3b8fb None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.176001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.176613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.176899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.177207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.186716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 975/1928] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:57.186869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.188727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.188727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.188954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.189132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.199353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 954/1929] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:57.200180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.217995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6eeb9d-5b8e-4317-a696-dcb71121cd50 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.218222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:57.218896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.289522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.290409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.290700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.290982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.291728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.293854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.296904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 976/1930] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:57.301750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.311920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad350416-61e9-48d5-8a44-b24e4d851b54 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.316777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.317422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.317707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.317982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.318660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:57.319067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.320878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.334360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 977/1931] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:57.339847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.350223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4e16-ed28-4488-bab8-a5b79bc11e0d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.355825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.356306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.356588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.356865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.357546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.359466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.388141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 955/1932] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:57.389574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.400433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff3f3c-42cc-4234-80e5-a4f91b13d450 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.405248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.405855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.406160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.406570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.407222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.408805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.421392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 956/1933] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:57.426094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.436006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42718eb2-12ba-4afa-9815-681c92a9d916 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.440835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.441462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.441750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.442034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] PATH_INFO: `/v3/projects/dfcd9b6727ad4d13a892606ea16b4304/users/95d6c3536a7845a4b93d888467b429d8/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.457518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcd9b6727ad4d13a892606ea16b4304, user_id=95d6c3536a7845a4b93d888467b429d8, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.460770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.530847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 978/1934] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:57.539549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.589487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 957/1935] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:57 2022] PUT /identity/v3/projects/dfcd9b6727ad4d13a892606ea16b4304/users/95d6c3536a7845a4b93d888467b429d8/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:57.594008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.621475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370af2a-aca6-42c2-9cbf-1b94536a9224 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.671863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d73d8-af50-4883-a5fb-548ceef032e9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.676953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.677671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.678375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.678516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.679054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.680764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.682415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.683036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.683329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.683603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.684250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.686250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.695341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 958/1936] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:57.696444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.706642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48eb69-e83d-4ff1-80d7-d402f43dcf2d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.713160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e234a-83c3-4a44-8d6e-9dbc36c07209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.721798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e234a-83c3-4a44-8d6e-9dbc36c07209 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.722087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e234a-83c3-4a44-8d6e-9dbc36c07209 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.722363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e234a-83c3-4a44-8d6e-9dbc36c07209 admin admin] PATH_INFO: `/v3/projects/dfcd9b6727ad4d13a892606ea16b4304/users/95d6c3536a7845a4b93d888467b429d8/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.729324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e234a-83c3-4a44-8d6e-9dbc36c07209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcd9b6727ad4d13a892606ea16b4304, user_id=95d6c3536a7845a4b93d888467b429d8, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.732096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e234a-83c3-4a44-8d6e-9dbc36c07209 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.747949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 959/1937] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:57 2022] PUT /identity/v3/projects/dfcd9b6727ad4d13a892606ea16b4304/users/95d6c3536a7845a4b93d888467b429d8/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:57.761104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.761400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.761750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.799374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] MFA Rules not processed for user `95d6c3536a7845a4b93d888467b429d8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:57.800732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.840168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 979/1938] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:57.842720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.856812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:57.882626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183306b-51a3-42f0-b4b3-1901c18c1b6d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.885831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 960/1939] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:57.886853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.953430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.954000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.954428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.955095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] PATH_INFO: `/v3/projects/50fb329d76c940e58a282926bdc4e03a` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.956087 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fb329d76c940e58a282926bdc4e03a)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.958156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.962647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c969-7c9b-4f8c-b1e3-77acf2ac441e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:57.967561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:57.968179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:57.968472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:57.968922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:57.969976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:57.971708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:57.985476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 961/1940] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:57.985476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:57.987345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:58.051964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fbc73-804f-4225-891f-d401ef47e599 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.056464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.057133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.057424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.057712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.136384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fb329d76c940e58a282926bdc4e03a', 'request_id': 'req-cb2d899b-85ea-4067-9e61-7093f7be6b66'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:58.144574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.146492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.157061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 962/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:58.157916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.170193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a02c6d-e3a6-46e9-894a-b7e4a92e29c4 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.244376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.245157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.248396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.248396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.248396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.248396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.261003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 963/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:58.263618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.275622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303baef-f6e4-40d0-88ff-b92fb11b6ada admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.276571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fb329d76c940e58a282926bdc4e03a', 'request_id': 'req-cb2d899b-85ea-4067-9e61-7093f7be6b66'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:58.283913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fb329d76c940e58a282926bdc4e03a', 'request_id': 'req-cb2d899b-85ea-4067-9e61-7093f7be6b66'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:58.292905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1bb42-6d48-44b3-82ef-d7ca90718113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.293619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1bb42-6d48-44b3-82ef-d7ca90718113 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.293908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1bb42-6d48-44b3-82ef-d7ca90718113 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.294194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1bb42-6d48-44b3-82ef-d7ca90718113 admin admin] PATH_INFO: `/v3/projects/9655eb7c9f9b4a109af236c608adf6cd/users/55d0259d68ff47a09913d06d1b9b45dd/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.296019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] The token cache is being invalidate because project 50fb329d76c940e58a282926bdc4e03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:14:58.296407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:58.297143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cb2d899b-85ea-4067-9e61-7093f7be6b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:14:58.299280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 980/1943] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:14:57 2022] DELETE /identity/v3/projects/50fb329d76c940e58a282926bdc4e03a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:14:58.303856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8790-c1f7-4c55-bba1-4e0999d0114b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.304324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8790-c1f7-4c55-bba1-4e0999d0114b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.311942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8790-c1f7-4c55-bba1-4e0999d0114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.312183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1bb42-6d48-44b3-82ef-d7ca90718113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9655eb7c9f9b4a109af236c608adf6cd, user_id=55d0259d68ff47a09913d06d1b9b45dd, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.314625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1bb42-6d48-44b3-82ef-d7ca90718113 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.325254 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-64bd8790-c1f7-4c55-bba1-4e0999d0114b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:58.326511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-64bd8790-c1f7-4c55-bba1-4e0999d0114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:58.336296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:58.340533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 981/1944] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:58.349066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.349278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.349651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.371421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:58.372636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:58.382001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 982/1945] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:58.388245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.401246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbba17-94a4-4d4d-9fd3-1cad34bf6317 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.406191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.406816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.407106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.407391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.408056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:14:58.408398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.410066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.428993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 983/1946] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:14:58.431142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.441660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18898aa9-aaf2-4459-9f1d-eb752e72a3e8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.472571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 964/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:58 2022] PUT /identity/v3/projects/9655eb7c9f9b4a109af236c608adf6cd/users/55d0259d68ff47a09913d06d1b9b45dd/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:58.483184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.483929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.484217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.507947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.507947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.507947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.507947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.508883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.510564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.532200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] MFA Rules not processed for user `55d0259d68ff47a09913d06d1b9b45dd`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:58.536372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:58.536372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:58.619945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 965/1948] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:58.624585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.626242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:58.640990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2d893-9a13-44a7-846d-494c1d3692ab None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.646063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.647173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.647511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.647797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.648465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.650487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.689285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 984/1949] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:58.690499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.753222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e305-a6b7-4d86-80ec-c5b6a4d708b6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.758820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.759505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.759712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.759991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.760625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.762713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.824485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 966/1950] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:58.825670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.843616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 985/1951] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:58.847103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.858002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091abeb4-4a13-422d-a7f4-0ad6b204c2ad admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.892802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be48a-7ba3-42f1-be34-854adece44c0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.898288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.899221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.899510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.899795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.900439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.902417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.926471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.927151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.927450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.927714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.929052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.930877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.941039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 986/1952] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:58.945947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.955704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc8fa2-8b7d-4916-8889-1ad7b516bd9f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.960661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.961282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.961575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.961856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:58.962491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:58.964076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:58.974433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 987/1953] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:58.978450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.984849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 967/1954] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:58 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:14:58.988611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b32d1-67a7-4a7e-a4e2-49a3859a6860 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:58.991465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:58.993914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c1daa-eae4-4341-9a0c-93337da21fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:58.994586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c1daa-eae4-4341-9a0c-93337da21fad admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:58.994936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c1daa-eae4-4341-9a0c-93337da21fad admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:58.995227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c1daa-eae4-4341-9a0c-93337da21fad admin admin] PATH_INFO: `/v3/projects/66d24f0c07f5426983a3124139fecc8b/users/678012852c2b4c60a07fdd8f10eb1bea/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.002552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de6cd-3e49-440c-bc69-4d81a5b68838 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.010258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.010717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.011005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.011283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.011396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c1daa-eae4-4341-9a0c-93337da21fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d24f0c07f5426983a3124139fecc8b, user_id=678012852c2b4c60a07fdd8f10eb1bea, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.011952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.013577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.014016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c1daa-eae4-4341-9a0c-93337da21fad admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.024960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 968/1955] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:59.028853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.039143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d928-c9a5-4307-90e5-4f18b111ca8d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.043857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.044457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.044747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.045059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.045798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.047283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.058414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 969/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:14:59.062327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.072699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3c65d-766e-491c-988d-f27b4f9329ca admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.077394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5123e16-5f59-4744-9e2c-44e2b5325b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.078042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5123e16-5f59-4744-9e2c-44e2b5325b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.078570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5123e16-5f59-4744-9e2c-44e2b5325b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.078712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5123e16-5f59-4744-9e2c-44e2b5325b43 admin admin] PATH_INFO: `/v3/projects/a59dee0708664ccfb73b187fe66ee317/users/3ec74f30e6784762b67855649b7f10cc/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.093957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5123e16-5f59-4744-9e2c-44e2b5325b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59dee0708664ccfb73b187fe66ee317, user_id=3ec74f30e6784762b67855649b7f10cc, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.096623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5123e16-5f59-4744-9e2c-44e2b5325b43 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.148978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 988/1957] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:58 2022] PUT /identity/v3/projects/66d24f0c07f5426983a3124139fecc8b/users/678012852c2b4c60a07fdd8f10eb1bea/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:59.160129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.160621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.161167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.168202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 970/1958] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:59 2022] PUT /identity/v3/projects/a59dee0708664ccfb73b187fe66ee317/users/3ec74f30e6784762b67855649b7f10cc/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:14:59.179768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.180117 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.180459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.215673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] MFA Rules not processed for user `678012852c2b4c60a07fdd8f10eb1bea`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:59.215673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:59.224551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] MFA Rules not processed for user `3ec74f30e6784762b67855649b7f10cc`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:14:59.227332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:59.323148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 989/1959] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:14:59.336476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.338146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:14:59.338738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 971/1960] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:14:59.344074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.440871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61bfaa-d857-4ed5-adf0-812d3e4d0486 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.453151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.453151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.453151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.453151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.465041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.467546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.490089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eb1c3-db33-4357-bf7b-67a0d35eda8a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.492811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 990/1961] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:14:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:14:59.505179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.514662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.514959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.515250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.515925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.525636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.652250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 972/1962] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:14:59 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:59.656746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.669446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6af27-247e-4e5e-a39a-2246cb969d07 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.720760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:59.755698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.758861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.758861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.758861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.758861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.760764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.867217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 991/1963] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:14:59 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:14:59.870656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.880823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13023504-6b7a-46ba-8032-d7ffaace4574 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.886728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.887347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.887636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.887949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.888601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.890348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:14:59.901636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 973/1964] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:14:59.910996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:14:59.921176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e5b6a-b130-4ee0-a007-f7f96f201d78 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:14:59.925883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:14:59.926549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:14:59.926844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:14:59.927132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] PATH_INFO: `/v3/projects/6d4c24edda294359b469696572e6b70a/users/8f50849d512048c0bd4375255c46c78b/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:14:59.941969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4c24edda294359b469696572e6b70a, user_id=8f50849d512048c0bd4375255c46c78b, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:14:59.945457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:00.015481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 992/1965] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:14:59 2022] PUT /identity/v3/projects/6d4c24edda294359b469696572e6b70a/users/8f50849d512048c0bd4375255c46c78b/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:00.019595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:00.030769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50efea-e921-4a3c-a2fe-77a9be837896 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:00.093231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce80cee-b3af-4a6c-9954-426ac7270a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:00.093853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80cee-b3af-4a6c-9954-426ac7270a8e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:00.094134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80cee-b3af-4a6c-9954-426ac7270a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:00.094409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80cee-b3af-4a6c-9954-426ac7270a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:00.095052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce80cee-b3af-4a6c-9954-426ac7270a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:00.096645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce80cee-b3af-4a6c-9954-426ac7270a8e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:00.110913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 974/1966] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:00.112197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:00.123996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6ffe-d593-4548-b803-721994325b42 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:00.134489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:00.134489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:00.134489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:00.134489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] PATH_INFO: `/v3/projects/6d4c24edda294359b469696572e6b70a/users/8f50849d512048c0bd4375255c46c78b/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:00.140163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4c24edda294359b469696572e6b70a, user_id=8f50849d512048c0bd4375255c46c78b, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:00.143423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:00.163413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 993/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:00 2022] PUT /identity/v3/projects/6d4c24edda294359b469696572e6b70a/users/8f50849d512048c0bd4375255c46c78b/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:00.175513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:00.175870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:00.176276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:00.208747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] MFA Rules not processed for user `8f50849d512048c0bd4375255c46c78b`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:00.210870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:00.318461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 975/1968] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:00.327050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:00.329230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:00.485178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0857757-c305-4f0e-b1a8-75f4fbdf7847 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:00.488913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:00.489562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:00.490516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:00.490516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:00.557157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:00.558816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:00.568736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 994/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:00.819425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:02.625688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:02.712070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:02.919308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:02.930336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c647d-3800-4472-8a45-e420d54087a1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:02.934338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:02.935146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:02.935730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:02.936010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:02.995871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:02.997390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:03.007573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 976/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:04.767344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:04.776279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:04.777959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:04.930657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bcd7b-f6c1-4cf5-9d76-a696b4ad5c2c service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:04.945913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:04.946640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:04.946955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:04.947209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] PATH_INFO: `/v3/users/53b33e2c3de94b92b94ebd4c17b19594` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:04.951687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b33e2c3de94b92b94ebd4c17b19594)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:04.958424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:05.070629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:05.081355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcc7d-a793-459d-a3fc-8641dc55ab31 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:05.087804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355678a-53de-4671-a1a1-bf8a71a73ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:05.088734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355678a-53de-4671-a1a1-bf8a71a73ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:05.089240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355678a-53de-4671-a1a1-bf8a71a73ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:05.094228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355678a-53de-4671-a1a1-bf8a71a73ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:05.101583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355678a-53de-4671-a1a1-bf8a71a73ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:05.103927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355678a-53de-4671-a1a1-bf8a71a73ab4 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:05.127732 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 977/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:05.270783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b33e2c3de94b92b94ebd4c17b19594'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:05.271381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b33e2c3de94b92b94ebd4c17b19594'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:05.278496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b33e2c3de94b92b94ebd4c17b19594'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:05.355840 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b33e2c3de94b92b94ebd4c17b19594'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:05.371019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b33e2c3de94b92b94ebd4c17b19594'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:05.378033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 995/1972] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:04 2022] DELETE /identity/v3/users/53b33e2c3de94b92b94ebd4c17b19594 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:05.383108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:05.383399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:05.383678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:05.407888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:05.409150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:05.486141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 978/1973] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:05.493314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:05.495072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:05.559782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fd648-003c-4083-8962-67ff6765901d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:05.588588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:05.589739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:05.590199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:05.590717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:05.604535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:05.606364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:05.618959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 996/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:06.143682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:06.160611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:06.162553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:06.234675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0344f-9e49-42ba-bc7b-c92d50faff84 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:06.239504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:06.240130 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:06.241043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:06.242031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:06.244030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:06.329968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:06.332332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:06.341052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:06.342859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:06.348454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 979/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:06.368086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d47a6-9bd7-4632-8426-b0bdcc82b6ed service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:06.374370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:06.375026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:06.375505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:06.375790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] PATH_INFO: `/v3/projects/5be1630d9dc04434a6127b055d12f48a` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:06.377071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be1630d9dc04434a6127b055d12f48a)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:06.379675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:06.553015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be1630d9dc04434a6127b055d12f48a', 'request_id': 'req-aa365c26-6a37-4945-a956-bfeb471ae2de'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:06.618812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be1630d9dc04434a6127b055d12f48a', 'request_id': 'req-aa365c26-6a37-4945-a956-bfeb471ae2de'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:06.627645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be1630d9dc04434a6127b055d12f48a', 'request_id': 'req-aa365c26-6a37-4945-a956-bfeb471ae2de'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:06.644521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] The token cache is being invalidate because project 5be1630d9dc04434a6127b055d12f48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:06.644913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:06.645725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:06.649100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 997/1976] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:06 2022] DELETE /identity/v3/projects/5be1630d9dc04434a6127b055d12f48a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:06.652801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:06.669282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ab342-dd5e-4fc2-b555-aee2ffa260f3 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:06.808859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:06.810065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:06.810470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:06.810820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] PATH_INFO: `/v3/users/fa2c84f6fc4d4c84b97f31211190cf28` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:06.812314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2c84f6fc4d4c84b97f31211190cf28)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:06.815083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:07.014363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2c84f6fc4d4c84b97f31211190cf28'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:07.023239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2c84f6fc4d4c84b97f31211190cf28'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:07.024329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2c84f6fc4d4c84b97f31211190cf28'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:07.025775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2c84f6fc4d4c84b97f31211190cf28'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:07.149532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-00021047-7d3c-4f1d-93a9-67e3c9f13ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2c84f6fc4d4c84b97f31211190cf28'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:07.186186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 980/1977] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:06 2022] DELETE /identity/v3/users/fa2c84f6fc4d4c84b97f31211190cf28 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:07.254694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:08.144586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:08.146182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:08.162620 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa365c26-6a37-4945-a956-bfeb471ae2de admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:08.249384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:08.250352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:08.254237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:08.254731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] PATH_INFO: `/v3/projects/3c19abc8c0a0402280a9c91bc1747f03` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:08.257008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c19abc8c0a0402280a9c91bc1747f03)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:08.259794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:08.386286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c19abc8c0a0402280a9c91bc1747f03', 'request_id': 'req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:08.574464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c19abc8c0a0402280a9c91bc1747f03', 'request_id': 'req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:08.581362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c19abc8c0a0402280a9c91bc1747f03', 'request_id': 'req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:08.596654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] The token cache is being invalidate because project 3c19abc8c0a0402280a9c91bc1747f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:08.597991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:08.597991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f6d66f9c-ffde-4bae-95b7-aa35533b2ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:08.600687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 998/1978] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:08 2022] DELETE /identity/v3/projects/3c19abc8c0a0402280a9c91bc1747f03 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:08.605997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:08.606920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:08.608505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:08.637958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:08.639511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:08.706469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 981/1979] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:08.715696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:08.715985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:08.716266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:08.736821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:08.738114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:08.747742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 999/1980] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:08.752104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:08.762894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b76545-f8ac-46ca-933a-c9d74eb6546b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:08.767524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:08.768400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:08.768694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:08.768995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:08.769647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:08.769950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:08.771567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:08.783874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 982/1981] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:08.789225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:08.798631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607007bd-0b10-4ee1-85dc-b6e0ad477f44 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:08.804808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:08.805559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:08.805997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:08.806287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:08.806952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:08.808883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:08.925737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1000/1982] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:08 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:08.926899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:08.939475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e182ef-58ef-4cd9-821d-c0f609de1d99 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:09.000611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:09.001276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.001558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.001836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.002487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:09.004654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:09.039453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:09.139780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 983/1983] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:08 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:09.141744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:09.153604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711714c3-bc12-4c7a-a6f9-b1676336ea39 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:09.158830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:09.159513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.159868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.160234 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.161127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:09.163270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:09.179939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1001/1984] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:09.180551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:09.204201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb799-fae2-4cc9-9b00-3503f7dccdeb admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:09.209426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24b57-97fc-4b08-873b-80c2adfdeb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:09.210171 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24b57-97fc-4b08-873b-80c2adfdeb88 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.210460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24b57-97fc-4b08-873b-80c2adfdeb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.210738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24b57-97fc-4b08-873b-80c2adfdeb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.211385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d24b57-97fc-4b08-873b-80c2adfdeb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:09.213456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d24b57-97fc-4b08-873b-80c2adfdeb88 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:09.227796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 984/1985] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:09.229381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:09.241414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15baa42-16ea-474a-8099-3522bdeba4cf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:09.247231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:09.248120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.248487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.248846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] PATH_INFO: `/v3/projects/cbda935ed4cd48f1a466f9ed590db1c5/users/5debec0823a64e64b70946af095bc26f/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.267396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbda935ed4cd48f1a466f9ed590db1c5, user_id=5debec0823a64e64b70946af095bc26f, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:09.270978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:09.394818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1002/1986] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:09 2022] PUT /identity/v3/projects/cbda935ed4cd48f1a466f9ed590db1c5/users/5debec0823a64e64b70946af095bc26f/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:09.395847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.396150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.396437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.448322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] MFA Rules not processed for user `5debec0823a64e64b70946af095bc26f`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:09.449840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:09.535062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 985/1987] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:09.539696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:09.600314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb8e9-896f-4d70-b21a-8cedf880ef7a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:09.605276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:09.605894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.606204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.606444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.607078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:09.614245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:09.750429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1003/1988] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:09 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:09.751651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:09.780548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5918e-d510-4f7b-a614-a473734b402a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:09.889348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:09.890563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:09.890929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:09.891504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:09.892966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:09.895294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:10.026310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 986/1989] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:09 2022] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:10.031080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:10.047243 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c9157-3d44-4b64-9d28-769447b99ecf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:10.064352 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:10.065566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.067822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.067822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.067822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:10.072682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:10.099105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1004/1990] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:10.103435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:10.118307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0fcdc-195c-446b-a8fe-dbb5d3d96531 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:10.135300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:10.135998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.136290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.136570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] PATH_INFO: `/v3/projects/7958fd29855747ba91378bc4c85f6e8c/users/8d60c8575cc24972b879a823aef400ab/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.156368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7958fd29855747ba91378bc4c85f6e8c, user_id=8d60c8575cc24972b879a823aef400ab, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:10.159473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:10.288344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:10.294922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 987/1991] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:10 2022] PUT /identity/v3/projects/7958fd29855747ba91378bc4c85f6e8c/users/8d60c8575cc24972b879a823aef400ab/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:10.299061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:10.321960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6d222-06ed-418b-b8ad-92c090a7c689 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:10.411465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb76e-1360-4165-a8a0-a4070e1aaeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:10.413122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb76e-1360-4165-a8a0-a4070e1aaeee admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.415551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb76e-1360-4165-a8a0-a4070e1aaeee admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.416256 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb76e-1360-4165-a8a0-a4070e1aaeee admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.417701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb76e-1360-4165-a8a0-a4070e1aaeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:10.420173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb76e-1360-4165-a8a0-a4070e1aaeee admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:10.445757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1005/1992] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:10.452339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:10.478620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742a57-b218-4b9d-a40a-28e4f03b5375 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:10.478620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:10.478620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.478620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.478945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] PATH_INFO: `/v3/projects/7958fd29855747ba91378bc4c85f6e8c/users/8d60c8575cc24972b879a823aef400ab/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.479266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7958fd29855747ba91378bc4c85f6e8c, user_id=8d60c8575cc24972b879a823aef400ab, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:10.483689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:10.494983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 988/1993] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:10 2022] PUT /identity/v3/projects/7958fd29855747ba91378bc4c85f6e8c/users/8d60c8575cc24972b879a823aef400ab/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:10.505441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.505733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.506586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.548914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] MFA Rules not processed for user `8d60c8575cc24972b879a823aef400ab`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:10.550687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:10.691036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1006/1994] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:10.704609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:10.705719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:10.767470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bebd6-3e9a-4f3b-8a6d-f087a3bd3af0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:10.772131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f86a3-a30c-4105-bf59-dbe23248d26c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:10.772972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f86a3-a30c-4105-bf59-dbe23248d26c service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.773368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f86a3-a30c-4105-bf59-dbe23248d26c service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.773812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f86a3-a30c-4105-bf59-dbe23248d26c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.786535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f86a3-a30c-4105-bf59-dbe23248d26c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:10.788883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f86a3-a30c-4105-bf59-dbe23248d26c service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:10.800391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 989/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:10.829942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:10.897341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f560-a345-4096-87e0-2d1ae344f981 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:10.907135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:10.908507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:10.909160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:10.909643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] PATH_INFO: `/v3/users/5debec0823a64e64b70946af095bc26f` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:10.911058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5debec0823a64e64b70946af095bc26f)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:10.913978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:11.117749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5debec0823a64e64b70946af095bc26f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:11.118544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5debec0823a64e64b70946af095bc26f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:11.126220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5debec0823a64e64b70946af095bc26f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:11.196282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5debec0823a64e64b70946af095bc26f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:11.212152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5debec0823a64e64b70946af095bc26f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:11.218268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1007/1996] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:10 2022] DELETE /identity/v3/users/5debec0823a64e64b70946af095bc26f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:11.222932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:11.231471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:11.231471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:11.243260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:11.244463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:11.306334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 990/1997] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:11.316307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:11.317787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:11.376519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e917-be4b-44ac-a005-24c0ca5acc05 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:11.380496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:11.381795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:11.382124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:11.382412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:11.391846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:11.393366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:11.403372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1008/1998] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:11.902513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:11.903972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:11.917264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6963c62-87af-46fb-8f82-64a8953cbd75 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:11.922035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:11.922684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:11.922964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:11.923402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] PATH_INFO: `/v3/projects/cbda935ed4cd48f1a466f9ed590db1c5` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:11.925383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbda935ed4cd48f1a466f9ed590db1c5)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:11.930293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:12.059597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:12.061230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:12.070870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbda935ed4cd48f1a466f9ed590db1c5', 'request_id': 'req-05c5373c-5279-45b0-9684-a084fa52c4b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.078058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83862032-4fa1-438a-98b7-e502ecd018dc service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:12.078824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbda935ed4cd48f1a466f9ed590db1c5', 'request_id': 'req-05c5373c-5279-45b0-9684-a084fa52c4b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.085682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbda935ed4cd48f1a466f9ed590db1c5', 'request_id': 'req-05c5373c-5279-45b0-9684-a084fa52c4b3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.152259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:12.152921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:12.153250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:12.153537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] PATH_INFO: `/v3/users/55d0259d68ff47a09913d06d1b9b45dd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:12.154873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d0259d68ff47a09913d06d1b9b45dd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:12.156860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:12.221948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] The token cache is being invalidate because project cbda935ed4cd48f1a466f9ed590db1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:12.221948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.221948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.223658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 991/1999] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:11 2022] DELETE /identity/v3/projects/cbda935ed4cd48f1a466f9ed590db1c5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:12.228655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:12.230114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:12.245426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5373c-5279-45b0-9684-a084fa52c4b3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:12.250897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:12.251695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:12.252046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:12.252325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] PATH_INFO: `/v3/users/8d60c8575cc24972b879a823aef400ab` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:12.253580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d60c8575cc24972b879a823aef400ab)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:12.255864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:12.260338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:12.532975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d0259d68ff47a09913d06d1b9b45dd'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.533656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d0259d68ff47a09913d06d1b9b45dd'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.543583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d0259d68ff47a09913d06d1b9b45dd'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.564147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:12.586777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d60c8575cc24972b879a823aef400ab'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.594885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d60c8575cc24972b879a823aef400ab'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.595680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d60c8575cc24972b879a823aef400ab'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.596305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d60c8575cc24972b879a823aef400ab'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.641785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d0259d68ff47a09913d06d1b9b45dd'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.657137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-49a8cf7a-534f-4b75-8921-e076497482ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d0259d68ff47a09913d06d1b9b45dd'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.664105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1009/2000] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:12 2022] DELETE /identity/v3/users/55d0259d68ff47a09913d06d1b9b45dd => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:12.669186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:12.669480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:12.669764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:12.693052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:12.695160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:12.732975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d60c8575cc24972b879a823aef400ab'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:12.758345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 992/2001] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:12 2022] DELETE /identity/v3/users/8d60c8575cc24972b879a823aef400ab => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:12.772246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1010/2002] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:12.783283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:12.784795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:12.858957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a37467-8c58-49e2-a6c2-0c6c6bf252e5 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:12.862948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:12.863640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:12.863927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:12.864204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:12.949427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:12.951573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:12.963507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 993/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:13.278420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:13.279963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:13.292905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6381-1f04-4a77-a101-b7047c770425 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:13.298045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:13.298703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.299020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.299293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] PATH_INFO: `/v3/projects/7958fd29855747ba91378bc4c85f6e8c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.300449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7958fd29855747ba91378bc4c85f6e8c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:13.303445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:13.448888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7958fd29855747ba91378bc4c85f6e8c', 'request_id': 'req-f3cc8598-0c00-49b2-958f-a83b986266a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.484012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:13.485975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:13.515026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99c869-61d1-43ce-82c8-eb0df08e4344 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:13.533306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7958fd29855747ba91378bc4c85f6e8c', 'request_id': 'req-f3cc8598-0c00-49b2-958f-a83b986266a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.549488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7958fd29855747ba91378bc4c85f6e8c', 'request_id': 'req-f3cc8598-0c00-49b2-958f-a83b986266a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.563235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] The token cache is being invalidate because project 7958fd29855747ba91378bc4c85f6e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:13.563534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.564515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f3cc8598-0c00-49b2-958f-a83b986266a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.566610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1011/2004] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:13 2022] DELETE /identity/v3/projects/7958fd29855747ba91378bc4c85f6e8c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:13.574200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aea3b-48f4-4634-a2d3-c54a98359058 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.574550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aea3b-48f4-4634-a2d3-c54a98359058 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.574869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aea3b-48f4-4634-a2d3-c54a98359058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.615969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5e1aea3b-48f4-4634-a2d3-c54a98359058 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:13.617443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5e1aea3b-48f4-4634-a2d3-c54a98359058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:13.627477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:13.628222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.628568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1012/2005] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:13.628750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.629214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] PATH_INFO: `/v3/projects/9655eb7c9f9b4a109af236c608adf6cd` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.631663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9655eb7c9f9b4a109af236c608adf6cd)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:13.636253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:13.637391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.637690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.638146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.665643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:13.667843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:13.685658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1013/2006] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:13.690372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:13.709402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fed1d-b487-4b75-8ee4-4eb6265c9ffd None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:13.716086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:13.716720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.717042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.717336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.717989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:13.718305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:13.720009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:13.739113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1014/2007] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:13.752379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:13.774684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fed066-ba98-4f4d-a6a3-41b235c3941a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:13.789260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9655eb7c9f9b4a109af236c608adf6cd', 'request_id': 'req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.800288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9655eb7c9f9b4a109af236c608adf6cd', 'request_id': 'req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.807795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9655eb7c9f9b4a109af236c608adf6cd', 'request_id': 'req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.842305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:13.883610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:13.884822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.884822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.884822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.885458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:13.887380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:13.928681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] The token cache is being invalidate because project 9655eb7c9f9b4a109af236c608adf6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:13.929045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.929805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:13.931468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 994/2008] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:13 2022] DELETE /identity/v3/projects/9655eb7c9f9b4a109af236c608adf6cd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:13.935502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:13.936880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:13.951090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234bb82-82fb-4e36-aba7-0e4ed08d6ab1 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:13.956042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:13.957245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:13.957245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:13.957245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] PATH_INFO: `/v3/users/3ec74f30e6784762b67855649b7f10cc` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:13.958531 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec74f30e6784762b67855649b7f10cc)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:13.961707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:13.997600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1015/2009] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:13 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:13.998736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.000563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.071873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c49a-aedd-4b8f-af1c-e78a69b15e16 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.080476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.081144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.081437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.081728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.082374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.084425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.167059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1016/2010] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:13 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:14.171484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.175284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec74f30e6784762b67855649b7f10cc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.183740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec74f30e6784762b67855649b7f10cc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.184446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920e49-4fc0-466b-aec1-f912225a95ad admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.184570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec74f30e6784762b67855649b7f10cc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.185198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec74f30e6784762b67855649b7f10cc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.190315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.197236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.197236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.197236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.197236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.197236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.204479 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1017/2011] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:14.205323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.207005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.219290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67525cb-373f-4c64-b6c1-96f95c2679a4 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.223826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.224440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.226242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.226242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] PATH_INFO: `/v3/users/2fcdf042bb42406397415efb7d2ecdb4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.226683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcdf042bb42406397415efb7d2ecdb4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.228598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.274303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec74f30e6784762b67855649b7f10cc'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.298424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 995/2012] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:13 2022] DELETE /identity/v3/users/3ec74f30e6784762b67855649b7f10cc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:14.299696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.310712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.421816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70891022-99e2-4bd7-9036-4e92d2131910 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.428280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.429285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.429680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.430068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.430842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.431014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcdf042bb42406397415efb7d2ecdb4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.431895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcdf042bb42406397415efb7d2ecdb4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.432804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.443073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcdf042bb42406397415efb7d2ecdb4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.449454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 996/2013] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:14.451641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.464993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55f3a-b126-4ff8-89a7-d890fd6c00c7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.469228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70043ea6-186e-44c3-9271-940a418c5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.469924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70043ea6-186e-44c3-9271-940a418c5a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.470214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70043ea6-186e-44c3-9271-940a418c5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.471092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70043ea6-186e-44c3-9271-940a418c5a47 admin admin] PATH_INFO: `/v3/projects/02d4c3af8e0a46298d01d15f302a1759/users/b935e9a9d6de4b98979d6d52aa14af12/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.488322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70043ea6-186e-44c3-9271-940a418c5a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d4c3af8e0a46298d01d15f302a1759, user_id=b935e9a9d6de4b98979d6d52aa14af12, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.491715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70043ea6-186e-44c3-9271-940a418c5a47 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.538550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcdf042bb42406397415efb7d2ecdb4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.552554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7aa6277c-bafa-4443-82ea-94fcff977802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcdf042bb42406397415efb7d2ecdb4'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:14.560144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1018/2014] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:14 2022] DELETE /identity/v3/users/2fcdf042bb42406397415efb7d2ecdb4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:14.564805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.565288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.565790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.574580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 997/2015] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:14 2022] PUT /identity/v3/projects/02d4c3af8e0a46298d01d15f302a1759/users/b935e9a9d6de4b98979d6d52aa14af12/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:14.587650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.588100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.588404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.599369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:14.601313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.624284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] MFA Rules not processed for user `b935e9a9d6de4b98979d6d52aa14af12`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:14.625556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.676566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1019/2016] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:14.688073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.689639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.717092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 998/2017] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:14.718917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.720376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.737190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e8a5-1d7c-45ac-b895-2f2377958665 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.741637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:14.746926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.747579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.747862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.748139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.748819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.750959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.765918 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a8ca-be2e-46e3-98cb-74bbe2f9f4a2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.769882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.770530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.770816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.771094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.781975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.783422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.793504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1020/2018] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:14.848782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.852925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:14.866517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 999/2019] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:14 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:14.869532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:14.889947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61589-9f8e-4eb5-8adf-8b50cf99994d service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:14.986467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:14.987574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.987921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.988178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] PATH_INFO: `/v3/projects/a59dee0708664ccfb73b187fe66ee317` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.989524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59dee0708664ccfb73b187fe66ee317)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:14.992552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:14.997446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540be299-a73b-41e6-8a7f-49895eedb4c0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.018393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.019116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.019474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.019822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.020535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.023638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.104776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59dee0708664ccfb73b187fe66ee317', 'request_id': 'req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.122842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1000/2020] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:14 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:15.127501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.138853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c32a-a0df-4556-8146-8902773b20e6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.184844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59dee0708664ccfb73b187fe66ee317', 'request_id': 'req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.192777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59dee0708664ccfb73b187fe66ee317', 'request_id': 'req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.216058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] The token cache is being invalidate because project a59dee0708664ccfb73b187fe66ee317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:15.216430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.217802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.219689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1021/2021] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:14 2022] DELETE /identity/v3/projects/a59dee0708664ccfb73b187fe66ee317 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:15.225190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.226649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:15.230736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.231376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.231667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.231964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.232688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.234347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.242079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d599c-4099-4ddd-b0d1-8d9b370f1488 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.247643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.250665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1001/2022] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:15.250936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.250936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.250936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] PATH_INFO: `/v3/users/8f50849d512048c0bd4375255c46c78b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.250936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f50849d512048c0bd4375255c46c78b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.251725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.252770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.253507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:15.269055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d988e-46b2-4b4a-ab77-a88eaa2748b8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.276411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.277484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.277989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.278269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.279184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.281236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.294670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1002/2023] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:15.298798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.310476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fbc1e-a2c5-4a0c-8c61-d19b98b3f793 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.317206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.317898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.318248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.319250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] PATH_INFO: `/v3/projects/4233da448616472a83e1f97295aa4626/users/79215d62d3b742c38090696d90277d8c/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.336774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4233da448616472a83e1f97295aa4626, user_id=79215d62d3b742c38090696d90277d8c, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.339548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.460467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1003/2024] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:15 2022] PUT /identity/v3/projects/4233da448616472a83e1f97295aa4626/users/79215d62d3b742c38090696d90277d8c/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:15.461164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.471518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:15.484157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f50849d512048c0bd4375255c46c78b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.485871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f50849d512048c0bd4375255c46c78b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.492830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f50849d512048c0bd4375255c46c78b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.542377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ced77-6894-4954-87f0-c94aa6340572 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.547440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.548110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.548423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.548746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] PATH_INFO: `/v3/projects/b4cf43beaf9343e684109cbeeaaf5d70` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.549937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4cf43beaf9343e684109cbeeaaf5d70)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.551850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.556063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f50849d512048c0bd4375255c46c78b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.572063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-429f87d0-6beb-4d16-b943-cb2a97d20b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f50849d512048c0bd4375255c46c78b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.578053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1022/2025] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:15 2022] DELETE /identity/v3/users/8f50849d512048c0bd4375255c46c78b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:15.579293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.579738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.580026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.610524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] MFA Rules not processed for user `79215d62d3b742c38090696d90277d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:15.611906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:15.687548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1023/2026] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:15.692210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.695033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:15.696301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:15.703403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4cf43beaf9343e684109cbeeaaf5d70', 'request_id': 'req-d08f03c6-f2ad-4b21-ae18-d53800e31735'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.709850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4cf43beaf9343e684109cbeeaaf5d70', 'request_id': 'req-d08f03c6-f2ad-4b21-ae18-d53800e31735'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.715533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4cf43beaf9343e684109cbeeaaf5d70', 'request_id': 'req-d08f03c6-f2ad-4b21-ae18-d53800e31735'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.766488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e886f4-bf37-4353-8a32-f7c0aff963a1 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.799583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] The token cache is being invalidate because project b4cf43beaf9343e684109cbeeaaf5d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:15.799953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.800663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:15.802225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1004/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:15 2022] DELETE /identity/v3/projects/b4cf43beaf9343e684109cbeeaaf5d70 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:15.808153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.809806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:15.843822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.844869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.845196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.845494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.846909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.850228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.890612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f03c6-f2ad-4b21-ae18-d53800e31735 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:15.897548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:15.898919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:15.899210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:15.899694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] PATH_INFO: `/v3/users/95d6c3536a7845a4b93d888467b429d8` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:15.900969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d6c3536a7845a4b93d888467b429d8)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:15.903730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:15.971625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1024/2028] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:15 2022] POST /identity/v3/projects => generated 387 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:15.972796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:15.976048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.057534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dd7a9-a6ce-4729-8085-fa396045253e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.070868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.070868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.070868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.070868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.072999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.072999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.136172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d6c3536a7845a4b93d888467b429d8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.147007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d6c3536a7845a4b93d888467b429d8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.148787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d6c3536a7845a4b93d888467b429d8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.150432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d6c3536a7845a4b93d888467b429d8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.168490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1025/2029] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:15 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:16.168490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.169993 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.183964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237c48b-045e-4010-94c4-1825ee201163 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.190131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.190770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.191054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.191335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] PATH_INFO: `/v3/projects/6d4c24edda294359b469696572e6b70a` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.192467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4c24edda294359b469696572e6b70a)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.194645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.263068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d6c3536a7845a4b93d888467b429d8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.290767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1005/2030] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:15 2022] DELETE /identity/v3/users/95d6c3536a7845a4b93d888467b429d8 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:16.291850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.293551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.353049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4c24edda294359b469696572e6b70a', 'request_id': 'req-fb1c7738-0989-4991-8fb3-6b8b1b3db879'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.368550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:16.388372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f881cd-a9af-42f7-99a4-8d5a630ec319 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.424218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4c24edda294359b469696572e6b70a', 'request_id': 'req-fb1c7738-0989-4991-8fb3-6b8b1b3db879'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.432514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4c24edda294359b469696572e6b70a', 'request_id': 'req-fb1c7738-0989-4991-8fb3-6b8b1b3db879'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.444987 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] The token cache is being invalidate because project 6d4c24edda294359b469696572e6b70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:16.445333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.446023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fb1c7738-0989-4991-8fb3-6b8b1b3db879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:16.447538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1026/2031] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:16 2022] DELETE /identity/v3/projects/6d4c24edda294359b469696572e6b70a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:16.448763 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.449422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.449754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.450029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.450748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.452420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88e002-a705-45ca-b273-c275e295459c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.452629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88e002-a705-45ca-b273-c275e295459c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.452914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88e002-a705-45ca-b273-c275e295459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.461640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.471333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1006/2032] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:16.475624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.477351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.479269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-be88e002-a705-45ca-b273-c275e295459c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:16.480660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-be88e002-a705-45ca-b273-c275e295459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.491204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b65137-74e0-4913-b14c-b8c950d47f9e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.492123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1027/2033] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:16.497086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.497813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.498097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.498378 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] PATH_INFO: `/v3/projects/721f3f1cd3794519ae9a9bd80cb25f6c/users/29fb70a205f44c9e9ed87fd322b8d1dc/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.502452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.502772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.503053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.517391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721f3f1cd3794519ae9a9bd80cb25f6c, user_id=29fb70a205f44c9e9ed87fd322b8d1dc, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.522409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.538190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:16.539473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.548463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1028/2034] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:16.555505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.565900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ed9a-1964-469c-be41-5ce0b2be0c28 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.572403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.573059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.573341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.573616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.575899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:16.575899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.576285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.590237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1029/2035] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:16.594628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.608995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73097b8-abeb-423b-b77f-70e8ca24a27c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.614361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.615623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.615623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.616159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.616966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.619066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.672695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1007/2036] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:16 2022] PUT /identity/v3/projects/721f3f1cd3794519ae9a9bd80cb25f6c/users/29fb70a205f44c9e9ed87fd322b8d1dc/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:16.680154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.748855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a6466-7e18-4637-91b6-e0e0964a6250 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.753679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.754316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.754606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.754889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.755577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.758077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.768173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1008/2037] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:16.772790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.778658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1030/2038] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:16 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:16.784129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.784397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ed532-80c9-4120-b6ba-8735b5a38221 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.853794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.854496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.855069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.855234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] PATH_INFO: `/v3/projects/721f3f1cd3794519ae9a9bd80cb25f6c/users/29fb70a205f44c9e9ed87fd322b8d1dc/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.857516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721f3f1cd3794519ae9a9bd80cb25f6c, user_id=29fb70a205f44c9e9ed87fd322b8d1dc, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.860410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.866228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc0d0b-8da1-4dfd-b221-da17a6323810 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.872549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1009/2039] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:16 2022] PUT /identity/v3/projects/721f3f1cd3794519ae9a9bd80cb25f6c/users/29fb70a205f44c9e9ed87fd322b8d1dc/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:16.873486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:16.878169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:16.928714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9516b3-a539-4cea-8ca3-52744405c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.929475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9516b3-a539-4cea-8ca3-52744405c009 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.929764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9516b3-a539-4cea-8ca3-52744405c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.930047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9516b3-a539-4cea-8ca3-52744405c009 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.930706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9516b3-a539-4cea-8ca3-52744405c009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.933366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9516b3-a539-4cea-8ca3-52744405c009 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:16.947981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91386d6d-0919-4cd3-a248-327d11624ee4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:16.952704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:16.953377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:16.953660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:16.959213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] PATH_INFO: `/v3/projects/dfcd9b6727ad4d13a892606ea16b4304` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:16.959213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcd9b6727ad4d13a892606ea16b4304)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:16.959213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.025122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1031/2040] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:16 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:17.026378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.026797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.027085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.057773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] MFA Rules not processed for user `29fb70a205f44c9e9ed87fd322b8d1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:17.059144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.069280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcd9b6727ad4d13a892606ea16b4304', 'request_id': 'req-107910c3-e348-4199-9dc0-0e4cba2f1c9e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:17.075683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcd9b6727ad4d13a892606ea16b4304', 'request_id': 'req-107910c3-e348-4199-9dc0-0e4cba2f1c9e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:17.081219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcd9b6727ad4d13a892606ea16b4304', 'request_id': 'req-107910c3-e348-4199-9dc0-0e4cba2f1c9e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:17.130686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1032/2041] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:17.132146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.179867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] The token cache is being invalidate because project dfcd9b6727ad4d13a892606ea16b4304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:17.180414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:17.180926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:17.182519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1010/2042] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:16 2022] DELETE /identity/v3/projects/dfcd9b6727ad4d13a892606ea16b4304 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:17.183297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.184805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.201268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f91d-b6fb-437a-80af-a58048d9afdb None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.206027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92775bd-94c1-4a55-a905-444a8da096c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.206532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92775bd-94c1-4a55-a905-444a8da096c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.206822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92775bd-94c1-4a55-a905-444a8da096c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.207109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92775bd-94c1-4a55-a905-444a8da096c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.207759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92775bd-94c1-4a55-a905-444a8da096c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.209520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92775bd-94c1-4a55-a905-444a8da096c7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.219455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1033/2043] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:17.220636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.220961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.221230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.241864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:17.243079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.245168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107910c3-e348-4199-9dc0-0e4cba2f1c9e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.248920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.249593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.249935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.250156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.251224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1034/2044] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:17.252038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.252331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.253529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.266614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8e0d8-1d07-44a5-9e63-a6b3000923bf None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.270866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.272167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.272808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.273037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eef62b-3b48-46cc-9e9c-a4091c51ede7 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.273137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.273397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.274062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.275807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.283240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1011/2045] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:17.284326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.284617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.284957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.285871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1035/2046] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:17.290308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.301453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da67d-5956-4744-84ef-27917e7dc436 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.307460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274f48c-0da2-46dc-9615-1205ec50d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.308384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f48c-0da2-46dc-9615-1205ec50d464 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.308640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f48c-0da2-46dc-9615-1205ec50d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.308922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f48c-0da2-46dc-9615-1205ec50d464 admin admin] PATH_INFO: `/v3/projects/4b4254ed01654f03978b540db1904b45/users/316fd8875e1e44288d0d44494839439b/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.312203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:17.314462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.325233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1012/2047] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:17.326507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274f48c-0da2-46dc-9615-1205ec50d464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4254ed01654f03978b540db1904b45, user_id=316fd8875e1e44288d0d44494839439b, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.329593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.329711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274f48c-0da2-46dc-9615-1205ec50d464 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.340607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62806ac3-5ae4-430e-94a3-9565e16f106f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.349522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.349522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.349522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.349522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.349975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:17.349975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.349975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.362408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1013/2048] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:17.368242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.378417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afd0d5-8fda-4262-86c6-bda4b4e161f7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.384656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.389870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.389870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.389870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.389870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.389870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.444406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1036/2049] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:17 2022] PUT /identity/v3/projects/4b4254ed01654f03978b540db1904b45/users/316fd8875e1e44288d0d44494839439b/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:17.454936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.455229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.455519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.484316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] MFA Rules not processed for user `316fd8875e1e44288d0d44494839439b`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:17.485576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.554559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1014/2050] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:17 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:17.556263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.582319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1037/2051] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:17.591412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.592810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:17.640247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331224-7584-4af8-8d82-78ede28acc97 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.645108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.645767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.646069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.646387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.647037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.648970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.655334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fa75a-813d-4e13-acf4-d02fef33fe5b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.717653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.718935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.719615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.721380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.723503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:17.794514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1015/2052] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:17 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:17.795752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.796576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.798104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.811922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d917406-a0e8-4e03-aa4b-21461cbc35f5 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.817720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1038/2053] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:17.820879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.821556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.821841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.822123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.822785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.824419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.841850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1016/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:17.848383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.863150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2839-3805-4620-9fa1-8d42e5ecfeb9 service glance] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.870037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc5d93-0477-46f8-916b-733a26d492b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.870794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc5d93-0477-46f8-916b-733a26d492b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.871218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc5d93-0477-46f8-916b-733a26d492b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.871606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc5d93-0477-46f8-916b-733a26d492b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.872559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc5d93-0477-46f8-916b-733a26d492b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.874542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc5d93-0477-46f8-916b-733a26d492b6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:17.891988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:17.896834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1039/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:17.905285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6505f-7d47-4979-ad3d-f9e01bfda17e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:17.910934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:17.913606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:17.914207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:17.914493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] PATH_INFO: `/v3/projects/0c83b145cea641949afc6f0cc0b8c7bd/users/d89d632857554a5ab24af7d2892f4bc6/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:17.936099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c83b145cea641949afc6f0cc0b8c7bd, user_id=d89d632857554a5ab24af7d2892f4bc6, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:17.940073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.073137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1017/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:17 2022] PUT /identity/v3/projects/0c83b145cea641949afc6f0cc0b8c7bd/users/d89d632857554a5ab24af7d2892f4bc6/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:18.074499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.074974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.075414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.111146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] MFA Rules not processed for user `d89d632857554a5ab24af7d2892f4bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:18.112456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:18.183769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1040/2057] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:18.188489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.257142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4700ec-d7ac-4a06-b0b2-2fadce434eb9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.262103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.262728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.263074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.263333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.263993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.265958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.288227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:18.375170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:18.384481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1018/2058] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:18 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:18.388663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.401339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f49b2-852a-4f3a-9a57-571384e703ff None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.479455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.479696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.479961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.480331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.481113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.483525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.590701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1041/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:18 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:18.591954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.604272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3bb9e-31de-45ca-83c3-5615061ab5a3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.610200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.610837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.611126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.611437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.612341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.614302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.626900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1019/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:18.634538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.650652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999fbb-ceaa-47e9-8a3b-0e076cb158bd admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.658755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.659575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.659870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.660155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] PATH_INFO: `/v3/projects/e033badc557e4e80aeeb8eb6494b02ab/users/162bae987b0b4741bf8bc4e9b4543ad7/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.703601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.722124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e033badc557e4e80aeeb8eb6494b02ab, user_id=162bae987b0b4741bf8bc4e9b4543ad7, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.727514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.777412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3226527-4350-4680-9216-2f79159c6d8e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.781209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.781842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.782145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.782560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.784986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:18.815882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1042/2061] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:18 2022] PUT /identity/v3/projects/e033badc557e4e80aeeb8eb6494b02ab/users/162bae987b0b4741bf8bc4e9b4543ad7/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:18.817024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.915080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.916818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.927706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ab566-276a-4852-bee0-342fa91ce371 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.930590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1020/2062] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:18.935566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47802caf-98ce-43cf-8291-6998125b1e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.936222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802caf-98ce-43cf-8291-6998125b1e1d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.936512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802caf-98ce-43cf-8291-6998125b1e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.941517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47802caf-98ce-43cf-8291-6998125b1e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.942253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47802caf-98ce-43cf-8291-6998125b1e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.949072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47802caf-98ce-43cf-8291-6998125b1e1d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:18.962954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1043/2063] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:18.964281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:18.983128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace73a8-2f9a-4f3f-9fe7-122f241e7859 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:18.988653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:18.989383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:18.989673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:18.989974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] PATH_INFO: `/v3/projects/e033badc557e4e80aeeb8eb6494b02ab/users/162bae987b0b4741bf8bc4e9b4543ad7/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:18.992334 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e033badc557e4e80aeeb8eb6494b02ab, user_id=162bae987b0b4741bf8bc4e9b4543ad7, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:18.995229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:19.007721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1021/2064] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:18 2022] PUT /identity/v3/projects/e033badc557e4e80aeeb8eb6494b02ab/users/162bae987b0b4741bf8bc4e9b4543ad7/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:19.029971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:19.030288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:19.030573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:19.105540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] MFA Rules not processed for user `162bae987b0b4741bf8bc4e9b4543ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:19.105540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:19.157014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1044/2065] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:19.415681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:19.417534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:19.527777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5a70-be4c-43fd-b6a5-da3d8de9797f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:19.532039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa66b2-98de-4da3-90e6-87a73a9eb9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:19.533120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa66b2-98de-4da3-90e6-87a73a9eb9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:19.533409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa66b2-98de-4da3-90e6-87a73a9eb9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:19.533731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa66b2-98de-4da3-90e6-87a73a9eb9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:19.617043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa66b2-98de-4da3-90e6-87a73a9eb9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:19.618584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa66b2-98de-4da3-90e6-87a73a9eb9f5 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:19.628994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1022/2066] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:20.339086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:20.469552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:21.160639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:21.165839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:21.315301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6930c-d0d0-43e8-a7f3-81a4987093fa None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:21.324847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:21.325542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:21.325824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:21.326113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] PATH_INFO: `/v3/users/678012852c2b4c60a07fdd8f10eb1bea` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:21.327295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678012852c2b4c60a07fdd8f10eb1bea)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:21.329690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:21.575394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678012852c2b4c60a07fdd8f10eb1bea'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:21.576125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678012852c2b4c60a07fdd8f10eb1bea'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:21.583125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678012852c2b4c60a07fdd8f10eb1bea'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:21.647396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678012852c2b4c60a07fdd8f10eb1bea'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:21.661507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678012852c2b4c60a07fdd8f10eb1bea'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:21.669674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1045/2067] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:21 2022] DELETE /identity/v3/users/678012852c2b4c60a07fdd8f10eb1bea => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:21.674127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:21.674635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:21.674635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:21.705055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:21.708821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:21.781374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1023/2068] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:21.818460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:21.821187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:21.882470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15af3ce-731f-4fb8-a6fc-d39fbf16ad53 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:21.886362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c5db-96a3-4d05-ba9e-9c07d41ae882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:21.887016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c5db-96a3-4d05-ba9e-9c07d41ae882 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:21.887308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c5db-96a3-4d05-ba9e-9c07d41ae882 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:21.887583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c5db-96a3-4d05-ba9e-9c07d41ae882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:21.899060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c5db-96a3-4d05-ba9e-9c07d41ae882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:21.900546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c5db-96a3-4d05-ba9e-9c07d41ae882 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:21.907244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:21.915938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1046/2069] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:21.997543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:22.677263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:22.680671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:22.715286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9110c2-64db-414b-89ab-b47897051c99 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:22.732129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:22.732129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.732129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.732129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] PATH_INFO: `/v3/projects/66d24f0c07f5426983a3124139fecc8b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.733665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d24f0c07f5426983a3124139fecc8b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:22.735583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:22.854353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d24f0c07f5426983a3124139fecc8b', 'request_id': 'req-b65a35ed-0be3-4527-a52c-c1419d63c1fa'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:22.860737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d24f0c07f5426983a3124139fecc8b', 'request_id': 'req-b65a35ed-0be3-4527-a52c-c1419d63c1fa'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:22.866777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d24f0c07f5426983a3124139fecc8b', 'request_id': 'req-b65a35ed-0be3-4527-a52c-c1419d63c1fa'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:22.958569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] The token cache is being invalidate because project 66d24f0c07f5426983a3124139fecc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:22.958888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:22.959765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b65a35ed-0be3-4527-a52c-c1419d63c1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:22.961824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1024/2070] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:22 2022] DELETE /identity/v3/projects/66d24f0c07f5426983a3124139fecc8b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:22.966659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49176-0cd5-4a61-991c-1074c73ed1b2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.967121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49176-0cd5-4a61-991c-1074c73ed1b2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.967227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49176-0cd5-4a61-991c-1074c73ed1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.977848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cf1d7-e85b-457b-a149-7122fc279173 None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.982277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cf1d7-e85b-457b-a149-7122fc279173 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.982277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cf1d7-e85b-457b-a149-7122fc279173 None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.982277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1025/2071] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:22.993070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-aff49176-0cd5-4a61-991c-1074c73ed1b2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:22.994738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-aff49176-0cd5-4a61-991c-1074c73ed1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.011746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.012795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.012795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.051367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:23.052829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.066652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1047/2072] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:23.076874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056daffa-555f-4734-b4f8-474f9196548a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.077398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056daffa-555f-4734-b4f8-474f9196548a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.077952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056daffa-555f-4734-b4f8-474f9196548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.121702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-056daffa-555f-4734-b4f8-474f9196548a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:23.123055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-056daffa-555f-4734-b4f8-474f9196548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.139732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1048/2073] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:23.141612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056daffa-555f-4734-b4f8-474f9196548a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:23.142308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-056daffa-555f-4734-b4f8-474f9196548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.142683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1026/2074] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:23.144233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:23.145507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.158040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056daffa-555f-4734-b4f8-474f9196548a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:23.161653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b943b-e2a6-47be-9d24-532b18a07973 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:23.163612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:23.164391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.164693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.164991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] PATH_INFO: `/v3/users/d89d632857554a5ab24af7d2892f4bc6` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.166162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89d632857554a5ab24af7d2892f4bc6)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:23.170282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:23.170407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:23.170407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.170407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.170407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] PATH_INFO: `/v3/users/a5ee4b8a68b142b3a367bd78eb3aeb39` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.171481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ee4b8a68b142b3a367bd78eb3aeb39)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:23.173552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:23.278428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:23.327594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:23.364246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ee4b8a68b142b3a367bd78eb3aeb39'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.364477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89d632857554a5ab24af7d2892f4bc6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.365238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89d632857554a5ab24af7d2892f4bc6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.371725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ee4b8a68b142b3a367bd78eb3aeb39'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.372350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89d632857554a5ab24af7d2892f4bc6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.372484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ee4b8a68b142b3a367bd78eb3aeb39'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.373090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ee4b8a68b142b3a367bd78eb3aeb39'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.548355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89d632857554a5ab24af7d2892f4bc6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.561418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89d632857554a5ab24af7d2892f4bc6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.567202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1049/2075] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:23 2022] DELETE /identity/v3/users/d89d632857554a5ab24af7d2892f4bc6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:23.568825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:23.570512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.610977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4a91adcd-cee9-4107-a2db-09afc8b9fcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ee4b8a68b142b3a367bd78eb3aeb39'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:23.629888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1027/2076] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:23 2022] DELETE /identity/v3/users/a5ee4b8a68b142b3a367bd78eb3aeb39 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:23.632100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df541f05-7003-4079-aa36-f55d1b9c221e None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.632482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df541f05-7003-4079-aa36-f55d1b9c221e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.632765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df541f05-7003-4079-aa36-f55d1b9c221e None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.638523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a9da9-ac8f-4935-8b94-b6a5b4ad9ea4 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:23.661203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1028/2077] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 30 01:15:23 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:23.664869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.667507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.669178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.705692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:23.706469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.706843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.707284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.708005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:23.708424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:23.710399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269b6e-a7f7-44ca-a302-b0cd222e587a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:23.719057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:23.720356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.722513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1050/2078] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:23.723772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.724241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.724701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.750505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] MFA Rules not processed for user `7eb699757f93461d8a1c29611d1204e8`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:23.751968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.770222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1029/2079] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:23.770222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:23.774240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc000-73a4-4391-894e-9e37f5039d80 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:23.781573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:23.782201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.782486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.782766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.783476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:23.785642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:23.877159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1051/2080] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 30 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:23.879321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:23.883964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.887789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1030/2081] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:23 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:23.890734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:23.949763 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202afe2-931b-42f2-a387-7b26fc97e1ae None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:23.978214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d66930-00bb-4bc8-bee5-8cbd30344d55 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:23.983659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:23.984320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:23.984606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:23.984914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:23.986706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:23.998777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.000440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.011074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.011474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.011633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.011922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.012877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1031/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:24.013728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.096809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.098322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.098752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835da5-dfbd-4283-9ce8-4c5a8cbb68ef service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.104027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.104633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.104918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.105225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.105854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.107813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.109386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1052/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:24.118615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.122248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.136701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d627a07-1202-4ec8-827d-65a08f62eb3d service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.141725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.142363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.142646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.142924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] PATH_INFO: `/v3/projects/935757e55bdc49e6a89b468d3c16e2ae` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.144049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935757e55bdc49e6a89b468d3c16e2ae)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.146088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.208103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1032/2084] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:24.212781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.222763 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc80b6-4ce0-4f51-a9d3-61a3eecfb9f3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.228174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.228765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.229089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.229370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.230050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.237510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.242015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1033/2085] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:24.246054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.259979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb48c-5172-4c8a-be8f-e744a835247f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.264851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.266865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.266865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.266865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.266865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.268445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.281940 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1034/2086] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:24.287831 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.304901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69efbf-3df5-4d28-95a5-8d94d1fb71b4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.317762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935757e55bdc49e6a89b468d3c16e2ae', 'request_id': 'req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.404157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3ed5-c869-44df-8500-9b989d4750f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.405724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3ed5-c869-44df-8500-9b989d4750f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.406876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3ed5-c869-44df-8500-9b989d4750f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.411479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3ed5-c869-44df-8500-9b989d4750f8 admin admin] PATH_INFO: `/v3/projects/02b7f4755a2249c79ad8013de035b908/users/a0a598ea0a984548b508bd583d311d31/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.417046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935757e55bdc49e6a89b468d3c16e2ae', 'request_id': 'req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.429749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935757e55bdc49e6a89b468d3c16e2ae', 'request_id': 'req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.442426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead3ed5-c869-44df-8500-9b989d4750f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b7f4755a2249c79ad8013de035b908, user_id=a0a598ea0a984548b508bd583d311d31, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.447076 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead3ed5-c869-44df-8500-9b989d4750f8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.454238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] The token cache is being invalidate because project 935757e55bdc49e6a89b468d3c16e2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:24.454804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.456031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9ec57ec7-7dba-4048-a7e5-b3afa218fd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.458452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1053/2087] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:24 2022] DELETE /identity/v3/projects/935757e55bdc49e6a89b468d3c16e2ae => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:24.465708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc322-008b-4672-ad76-66b3dce791db None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.466064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc322-008b-4672-ad76-66b3dce791db None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.466484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc322-008b-4672-ad76-66b3dce791db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.530741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6c7dc322-008b-4672-ad76-66b3dce791db None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:24.532740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6c7dc322-008b-4672-ad76-66b3dce791db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.546005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1054/2088] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:24.557476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.557775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.558038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.575766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1035/2089] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:24 2022] PUT /identity/v3/projects/02b7f4755a2249c79ad8013de035b908/users/a0a598ea0a984548b508bd583d311d31/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:24.580220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:24.581461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.589950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.590337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.595946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.627033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] MFA Rules not processed for user `a0a598ea0a984548b508bd583d311d31`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:24.630415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.655408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1055/2090] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:24.659781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.668671 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8775e2a-6783-487c-a4c6-62effc6be831 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.674011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.674592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.674922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.675207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.675870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:24.676499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.678462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.692839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1056/2091] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:24.692839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.696710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.706224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:24.712071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cc4c4-bfb6-4121-9b64-327a0a009aa5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.720708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.720708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.720708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.720708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] PATH_INFO: `/v3/projects/0c83b145cea641949afc6f0cc0b8c7bd` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.721461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c83b145cea641949afc6f0cc0b8c7bd)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.721461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.728202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1036/2092] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:24.729828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.740801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0458-76df-4b36-9863-3cffa83da596 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.745963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.746574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.746862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.747146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.747858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.749721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.843127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c83b145cea641949afc6f0cc0b8c7bd', 'request_id': 'req-845704d0-17d2-423a-b4ea-a573a0c08a2f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.892020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1037/2093] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:24.892613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.895068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.915832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c83b145cea641949afc6f0cc0b8c7bd', 'request_id': 'req-845704d0-17d2-423a-b4ea-a573a0c08a2f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.928378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c83b145cea641949afc6f0cc0b8c7bd', 'request_id': 'req-845704d0-17d2-423a-b4ea-a573a0c08a2f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.940460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] The token cache is being invalidate because project 0c83b145cea641949afc6f0cc0b8c7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:24.940882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.942193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:24.944414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1057/2094] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:24 2022] DELETE /identity/v3/projects/0c83b145cea641949afc6f0cc0b8c7bd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:24.948445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.949882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.977129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee0b4a-cfd5-433c-8f12-4099921f7ec9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.982675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.983384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.983668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.983949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.984591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.986629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.030242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845704d0-17d2-423a-b4ea-a573a0c08a2f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.035693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.036299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.036580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.036962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.037717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.039996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.092722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1038/2095] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:25.093896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.095829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.162835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f53469-a82f-41ec-88de-2044d730e59e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.167595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.168233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.168522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.168794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] PATH_INFO: `/v3/users/162bae987b0b4741bf8bc4e9b4543ad7` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.169994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] RBAC: Authorizing `identity:delete_user(user_id=162bae987b0b4741bf8bc4e9b4543ad7)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.171966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.183772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1058/2096] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:25.185108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.187100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.202415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca95ad-4703-4201-aa03-d14f1ca4f09e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.207165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.207774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.208059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.208337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.209220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.211078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.299135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:25.305587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1059/2097] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:25 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:25.306472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.316456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037deedc-9737-410d-a74d-9b98e3ac5f98 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.321694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.322280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.322568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.322864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.323492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.325234 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.337186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1060/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:25.341455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.348173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58882-f9d3-4896-aab4-73c2e48dd28d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.353539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.354131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.354419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.354703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.355344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.356970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.367770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1061/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:25.368645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.377994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee8d72-f702-444b-adfd-c8d46bbdfaf1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.383045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.383912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.384195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.384538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.385222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.387461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.402667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1062/2100] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:25.402667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.404435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162bae987b0b4741bf8bc4e9b4543ad7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:25.409419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35ed8-a2d0-45b7-9606-ebebb29cfa6a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.415781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.416261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.416587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.416867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.417557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.419189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.420173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162bae987b0b4741bf8bc4e9b4543ad7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:25.420941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162bae987b0b4741bf8bc4e9b4543ad7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:25.421580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162bae987b0b4741bf8bc4e9b4543ad7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:25.430698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1063/2101] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:25.431657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.433395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.446803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eece245-e717-46eb-9882-acf95d3620c2 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.451445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5afd9-d582-4a81-95fe-08c557f66854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.452089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5afd9-d582-4a81-95fe-08c557f66854 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.452374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5afd9-d582-4a81-95fe-08c557f66854 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.452654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5afd9-d582-4a81-95fe-08c557f66854 admin admin] PATH_INFO: `/v3/projects/3f30405ce0b743f9a71b8133bdd5daf6/users/8ac4b735c6de439290ef9ba28d3ad451/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.466556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5afd9-d582-4a81-95fe-08c557f66854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f30405ce0b743f9a71b8133bdd5daf6, user_id=8ac4b735c6de439290ef9ba28d3ad451, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.469314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5afd9-d582-4a81-95fe-08c557f66854 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.527404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162bae987b0b4741bf8bc4e9b4543ad7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:25.551675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1039/2102] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:25 2022] DELETE /identity/v3/users/162bae987b0b4741bf8bc4e9b4543ad7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:25.553430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.555160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.567209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1064/2103] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:25 2022] PUT /identity/v3/projects/3f30405ce0b743f9a71b8133bdd5daf6/users/8ac4b735c6de439290ef9ba28d3ad451/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:25.583258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.583837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.584305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.641663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] MFA Rules not processed for user `8ac4b735c6de439290ef9ba28d3ad451`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:25.643429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.668925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2550b-b0bf-4386-bbe0-2e27b592510e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.736426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ca31b-1184-4823-9b01-b626c3b5480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.737156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca31b-1184-4823-9b01-b626c3b5480d admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.737445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca31b-1184-4823-9b01-b626c3b5480d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.737734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ca31b-1184-4823-9b01-b626c3b5480d admin admin] PATH_INFO: `/v3/projects/52e18c8190e74cb5b3880b74582622e2/users/60585460f2974d6f8d322d5ef2277bfe/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.750458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1065/2104] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:25.755486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.756314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca31b-1184-4823-9b01-b626c3b5480d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e18c8190e74cb5b3880b74582622e2, user_id=60585460f2974d6f8d322d5ef2277bfe, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.759046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ca31b-1184-4823-9b01-b626c3b5480d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.767258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316877a-6fc5-41a8-a750-d53e763b6dc8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.776105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:25.776105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.776105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.776105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.776669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:25.776669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:25.836863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1040/2105] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:25 2022] PUT /identity/v3/projects/52e18c8190e74cb5b3880b74582622e2/users/60585460f2974d6f8d322d5ef2277bfe/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:25.850621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:25.850914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:25.851191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:25.890400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] MFA Rules not processed for user `60585460f2974d6f8d322d5ef2277bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:25.891674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.924927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1066/2106] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:25 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:25.924927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.926783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:25.971100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1041/2107] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:25.974052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:25.995618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0021-0efb-4e5f-b083-ce5d514eada8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:25.999632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.000252 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.000569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.000851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.002715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.042442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8225-e038-432f-973e-8a5a45c640ec None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.081927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.084057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.095531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1067/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:26.096643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.108232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.109082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.109763 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.110201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.110990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.113325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.187282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe70b1d-725d-4c51-ae50-b415ba28aa1b service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.197202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1042/2109] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:25 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:26.197690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.198480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.198845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.199164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.200341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.201510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.203816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.204215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.219443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d799ba-78dc-4364-bede-fb94886978cc admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.226632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.227397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.227682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.227963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] PATH_INFO: `/v3/projects/e033badc557e4e80aeeb8eb6494b02ab` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.229394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e033badc557e4e80aeeb8eb6494b02ab)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.231369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.332817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1068/2110] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:26.333732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.358763 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e033badc557e4e80aeeb8eb6494b02ab', 'request_id': 'req-36359544-ad49-4527-ad85-4f81badbcae3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:26.365196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e033badc557e4e80aeeb8eb6494b02ab', 'request_id': 'req-36359544-ad49-4527-ad85-4f81badbcae3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:26.371680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e033badc557e4e80aeeb8eb6494b02ab', 'request_id': 'req-36359544-ad49-4527-ad85-4f81badbcae3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:26.400154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548b10c-2781-4bbe-96ab-c6de36a8cd3d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.461036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] The token cache is being invalidate because project e033badc557e4e80aeeb8eb6494b02ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:26.461396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:26.462020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:26.463602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1043/2111] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:26 2022] DELETE /identity/v3/projects/e033badc557e4e80aeeb8eb6494b02ab => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:26.464180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf66620-8346-418c-b1f5-b768509cb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.464416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.464802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf66620-8346-418c-b1f5-b768509cb9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.465120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf66620-8346-418c-b1f5-b768509cb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.465401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf66620-8346-418c-b1f5-b768509cb9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.467098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf66620-8346-418c-b1f5-b768509cb9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.467224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.468040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf66620-8346-418c-b1f5-b768509cb9a6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.482103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1069/2112] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:26.482303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36359544-ad49-4527-ad85-4f81badbcae3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.482395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.482395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.482395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.484898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0717-76e1-42f4-89f8-9201f106e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.485521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0717-76e1-42f4-89f8-9201f106e41b admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.485808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0717-76e1-42f4-89f8-9201f106e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.486091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0717-76e1-42f4-89f8-9201f106e41b admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.486728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0717-76e1-42f4-89f8-9201f106e41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.488651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0717-76e1-42f4-89f8-9201f106e41b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.502794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:26.504109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.513569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1070/2113] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:26.519805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.519805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.531214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081672c8-a5bf-4e60-9324-40f2eb08c380 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.535828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.536470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.536783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.537175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] PATH_INFO: `/v3/projects/b2451e5f73284a689704909fd754c595/users/ba15bd42ac6241799ac991ae48e1543a/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.553907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2451e5f73284a689704909fd754c595, user_id=ba15bd42ac6241799ac991ae48e1543a, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.556821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.576709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1044/2114] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:26.576709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.576709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.576709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.597575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:26.598820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.606893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1045/2115] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:26.607666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.619048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352da4a-9b40-44bf-8b9d-fbde51d7a87d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.623824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.626869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.626869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.626869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.626869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.627238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.639187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1046/2116] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:26.639943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.653975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1071/2117] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:26 2022] PUT /identity/v3/projects/b2451e5f73284a689704909fd754c595/users/ba15bd42ac6241799ac991ae48e1543a/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:26.654806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.656414 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15672-681b-4a7a-9177-186ccd02ee3d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.721915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:26.722839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.723522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.723811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.724092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.724885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:26.725310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.726895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.738960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffd6f3-595d-4ba2-9e21-2d759fb2bfc8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.739338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1047/2118] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:26.740765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.748183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.748855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.749200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.753293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] PATH_INFO: `/v3/projects/ba1f6a3fc61a44ef94f036b39ea67ffa/users/db1f67eccd324251a6d16187e13c7d19/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.753485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4b023-1881-4e79-aea2-7bb2e67156cc admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.756565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.757204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.757491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.757769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.758419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.760013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.765097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1f6a3fc61a44ef94f036b39ea67ffa, user_id=db1f67eccd324251a6d16187e13c7d19, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.767761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.771292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1048/2119] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:26.772445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.784654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd667312-116e-4cab-9b59-9419cc807463 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.790300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.790927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.791207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.791481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.792257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.794317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.836259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1072/2120] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:26 2022] PUT /identity/v3/projects/ba1f6a3fc61a44ef94f036b39ea67ffa/users/db1f67eccd324251a6d16187e13c7d19/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:26.837103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.901617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccde97-2338-4d4e-b920-6fb9974a54cf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:26.906519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:26.907191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.909178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.909178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] PATH_INFO: `/v3/projects/b2451e5f73284a689704909fd754c595/users/ba15bd42ac6241799ac991ae48e1543a/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.909980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2451e5f73284a689704909fd754c595, user_id=ba15bd42ac6241799ac991ae48e1543a, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:26.912838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1049/2121] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:26.913720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:26.917142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.925709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1073/2122] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:26 2022] PUT /identity/v3/projects/b2451e5f73284a689704909fd754c595/users/ba15bd42ac6241799ac991ae48e1543a/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:26.926739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:26.995462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042481-47c3-4c03-9c60-04fb8087c107 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.007402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569018-005e-4e8f-b19e-78eeb2edac58 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.013852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.014504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.014797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.015076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.015714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.017789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.062071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe341180-2d58-4d74-b4c7-1bdb9b707740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.062709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe341180-2d58-4d74-b4c7-1bdb9b707740 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.062997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe341180-2d58-4d74-b4c7-1bdb9b707740 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.063306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe341180-2d58-4d74-b4c7-1bdb9b707740 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.063958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe341180-2d58-4d74-b4c7-1bdb9b707740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.065637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe341180-2d58-4d74-b4c7-1bdb9b707740 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.076118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1050/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:27.077498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d8ed-38c8-4d4e-b071-e98243fea80d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.077865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d8ed-38c8-4d4e-b071-e98243fea80d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.078154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d8ed-38c8-4d4e-b071-e98243fea80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.094314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1074/2124] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:27.100097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.105852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4697c-16d9-4ac4-8f98-fd9af81cb4ad admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.110713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-8793d8ed-38c8-4d4e-b071-e98243fea80d None None] MFA Rules not processed for user `ba15bd42ac6241799ac991ae48e1543a`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:27.110908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.111549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.111829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.111943 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8793d8ed-38c8-4d4e-b071-e98243fea80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.112113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] PATH_INFO: `/v3/projects/ba1f6a3fc61a44ef94f036b39ea67ffa/users/db1f67eccd324251a6d16187e13c7d19/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.114195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1f6a3fc61a44ef94f036b39ea67ffa, user_id=db1f67eccd324251a6d16187e13c7d19, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.117659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.132838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1075/2125] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:27 2022] PUT /identity/v3/projects/ba1f6a3fc61a44ef94f036b39ea67ffa/users/db1f67eccd324251a6d16187e13c7d19/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:27.133722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.192827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1051/2126] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:27.192827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.192827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.192827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.203916 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18d05-0850-4264-91a9-96b6beb2a0aa admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.209455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.210108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.210372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.210683 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.211340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.212997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.223266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1076/2127] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:27.230008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] MFA Rules not processed for user `db1f67eccd324251a6d16187e13c7d19`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:27.230008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.233000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.243851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba72d6-84ee-4b15-be54-bf263e4d5417 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.248680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.249294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.249583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.249866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.250516 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.252331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.255491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.264984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1077/2128] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:27.269180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.280471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eaa85-c30d-4391-8523-46516d45b3dd admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.286071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1b7d-5318-431e-98ca-45814fa77bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.303572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1b7d-5318-431e-98ca-45814fa77bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.303572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1b7d-5318-431e-98ca-45814fa77bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.303572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1b7d-5318-431e-98ca-45814fa77bfb admin admin] PATH_INFO: `/v3/projects/d895e1d3461d4c89b1be33b17fbd9b35/users/f0827052845841b7894bb58bdd5529d3/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.310649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1052/2129] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:27.325448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac1b7d-5318-431e-98ca-45814fa77bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d895e1d3461d4c89b1be33b17fbd9b35, user_id=f0827052845841b7894bb58bdd5529d3, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.326488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.328065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.328543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac1b7d-5318-431e-98ca-45814fa77bfb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.389041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fafe5-f738-48cd-836b-eaf054f40ad2 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.397908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.398536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.398816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.399091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.400853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.471872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1078/2130] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:27 2022] PUT /identity/v3/projects/d895e1d3461d4c89b1be33b17fbd9b35/users/f0827052845841b7894bb58bdd5529d3/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:27.477981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.479429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.486576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.486865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.487139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.488870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1053/2131] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:27.518825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] MFA Rules not processed for user `f0827052845841b7894bb58bdd5529d3`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:27.520092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.589706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1079/2132] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:27.733113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.739051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.745057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102999b-dc18-442b-b798-b29ba8a342fe service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.797757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.798367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.798648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.798922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.807968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.809437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.821187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1054/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:29.007895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:29.162036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:29.734209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:29.744644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b84d-765f-4333-a7fb-1cd56f873a6c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:29.749012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:29.749257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:29.749538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:29.749815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:29.752166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:29.838705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:29.840259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:29.854098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1080/2134] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:30.676016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:31.433710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.435267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:31.491687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.502054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f209190-e195-4dfa-b209-cb112023ecda service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.506582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.507812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.512463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.512463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.525514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eab66-5f66-49f3-b05c-7aeba11fc418 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.533114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:31.537197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.537674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.537926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.538204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] PATH_INFO: `/v3/users/b935e9a9d6de4b98979d6d52aa14af12` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.539343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b935e9a9d6de4b98979d6d52aa14af12)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.541521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.576582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.578075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.589036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1081/2135] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:31.673476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.682905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed11a-1f73-455d-bd6f-bedc90ede56d service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.686612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959541c7-65d4-4669-b12b-7226590d8f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.687374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959541c7-65d4-4669-b12b-7226590d8f33 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.687533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959541c7-65d4-4669-b12b-7226590d8f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.687811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959541c7-65d4-4669-b12b-7226590d8f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.754945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959541c7-65d4-4669-b12b-7226590d8f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.757223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959541c7-65d4-4669-b12b-7226590d8f33 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.767498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1082/2136] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:31.812568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b935e9a9d6de4b98979d6d52aa14af12'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:31.819532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b935e9a9d6de4b98979d6d52aa14af12'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:31.820551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b935e9a9d6de4b98979d6d52aa14af12'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:31.821137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b935e9a9d6de4b98979d6d52aa14af12'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:31.884122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b935e9a9d6de4b98979d6d52aa14af12'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:31.910477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1055/2137] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:31 2022] DELETE /identity/v3/users/b935e9a9d6de4b98979d6d52aa14af12 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:31.921197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.921197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.921197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.938841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:31.940181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.010077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1083/2138] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:32.020394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.024033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.107583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c413ca-86a0-45b1-b323-65c106b4f329 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.111728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.112344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.112623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.112898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.123704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.125187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.136968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1056/2139] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:32.586601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.588768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.607354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15cb96-b9ba-4622-846e-a8f063212f2c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.611696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.615248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.616245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.616424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.616728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] PATH_INFO: `/v3/projects/02d4c3af8e0a46298d01d15f302a1759` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.617981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d4c3af8e0a46298d01d15f302a1759)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.619966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.680410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.782884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d4c3af8e0a46298d01d15f302a1759', 'request_id': 'req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:32.827642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.831086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.877216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d4c3af8e0a46298d01d15f302a1759', 'request_id': 'req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:32.884706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d4c3af8e0a46298d01d15f302a1759', 'request_id': 'req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:32.898143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] The token cache is being invalidate because project 02d4c3af8e0a46298d01d15f302a1759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:32.898680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:32.901061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:32.905028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1084/2140] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:32 2022] DELETE /identity/v3/projects/02d4c3af8e0a46298d01d15f302a1759 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:32.905947 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.910199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.924927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aec8fa-5be1-4523-9cdd-cab141a8172f service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.980291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a8ae-de72-4722-ac33-88b4b94f27a8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.985347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.986029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.986289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.986571 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] PATH_INFO: `/v3/users/79215d62d3b742c38090696d90277d8c` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.987792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79215d62d3b742c38090696d90277d8c)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.989804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:33.109544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba15bd42ac6241799ac991ae48e1543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2451e5f73284a689704909fd754c595', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:33.110163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:33.110494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:33.110785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:33.111474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:33.111791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:33.113433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:33.125250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1057/2141] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:33.129476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:33.132601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:33.145314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750efda-a121-4b9f-b4fd-9a87dba5b32e tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:33.151451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba15bd42ac6241799ac991ae48e1543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2451e5f73284a689704909fd754c595', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:33.152059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:33.152364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:33.152625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:33.153291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:33.155315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:33.252751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1058/2142] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:33 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:33.253949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:33.283309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79215d62d3b742c38090696d90277d8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.283309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79215d62d3b742c38090696d90277d8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.286552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79215d62d3b742c38090696d90277d8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.325034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d094ef5-25d4-4082-b7d2-4c77084c41db tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:33.335937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba15bd42ac6241799ac991ae48e1543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2451e5f73284a689704909fd754c595', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:33.336557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:33.336847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:33.337229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:33.337893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:33.338203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:33.339945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:33.352617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1059/2143] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:33.412352 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:33.423227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4587c-4817-4dbb-825c-00e04f0059bf tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:33.429317 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba15bd42ac6241799ac991ae48e1543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2451e5f73284a689704909fd754c595', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:33.429965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:33.430254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:33.430538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] PATH_INFO: `/v3/projects/2a17fd69628e4d2c8551fa06a5e82eed` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:33.431684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a17fd69628e4d2c8551fa06a5e82eed)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:33.433748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:33.440144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79215d62d3b742c38090696d90277d8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.454488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79215d62d3b742c38090696d90277d8c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.460830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1085/2144] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:32 2022] DELETE /identity/v3/users/79215d62d3b742c38090696d90277d8c => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:33.539632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a17fd69628e4d2c8551fa06a5e82eed', 'request_id': 'req-d9fec034-2ed4-489c-bbb2-c477bec3516b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.546476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a17fd69628e4d2c8551fa06a5e82eed', 'request_id': 'req-d9fec034-2ed4-489c-bbb2-c477bec3516b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.552397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a17fd69628e4d2c8551fa06a5e82eed', 'request_id': 'req-d9fec034-2ed4-489c-bbb2-c477bec3516b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.623697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] The token cache is being invalidate because project 2a17fd69628e4d2c8551fa06a5e82eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:33.623990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.624621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:33.626149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1060/2145] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:33 2022] DELETE /identity/v3/projects/2a17fd69628e4d2c8551fa06a5e82eed => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:33.974082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:33.976691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.051586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071b26-3b4e-4b8e-a0b4-e9012157b0f2 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:34.110996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:34.111675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.112390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.112390 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] PATH_INFO: `/v3/projects/4233da448616472a83e1f97295aa4626` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.113395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4233da448616472a83e1f97295aa4626)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:34.115952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:34.208436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4233da448616472a83e1f97295aa4626', 'request_id': 'req-f764241e-e08f-46cc-8493-a0de19d3a902'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.308205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:34.309722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.321593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4233da448616472a83e1f97295aa4626', 'request_id': 'req-f764241e-e08f-46cc-8493-a0de19d3a902'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.324750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fec034-2ed4-489c-bbb2-c477bec3516b tempest-VolumeQuotaClassesTest-837102333 tempest-VolumeQuotaClassesTest-837102333-project-admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:34.328676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4233da448616472a83e1f97295aa4626', 'request_id': 'req-f764241e-e08f-46cc-8493-a0de19d3a902'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.340576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] The token cache is being invalidate because project 4233da448616472a83e1f97295aa4626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:34.341114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.346034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.346034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1086/2146] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:33 2022] DELETE /identity/v3/projects/4233da448616472a83e1f97295aa4626 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:34.348581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:34.350028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.398622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:34.399277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.399565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.399930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] PATH_INFO: `/v3/users/8ac4b735c6de439290ef9ba28d3ad451` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.401219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac4b735c6de439290ef9ba28d3ad451)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:34.403162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:34.428447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764241e-e08f-46cc-8493-a0de19d3a902 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:34.433508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:34.434310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.434603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.434884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] PATH_INFO: `/v3/users/29fb70a205f44c9e9ed87fd322b8d1dc` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.436081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fb70a205f44c9e9ed87fd322b8d1dc)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:34.438095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:34.592053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac4b735c6de439290ef9ba28d3ad451'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.599333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac4b735c6de439290ef9ba28d3ad451'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.600656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac4b735c6de439290ef9ba28d3ad451'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.601304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac4b735c6de439290ef9ba28d3ad451'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.619908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fb70a205f44c9e9ed87fd322b8d1dc'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.620635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fb70a205f44c9e9ed87fd322b8d1dc'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.627723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fb70a205f44c9e9ed87fd322b8d1dc'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.708065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-97a66f71-12ad-4a21-9a0e-bd2774c7bdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac4b735c6de439290ef9ba28d3ad451'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.728390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1061/2147] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:34 2022] DELETE /identity/v3/users/8ac4b735c6de439290ef9ba28d3ad451 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:34.732929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.733299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.733576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.754532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:34.756360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.765774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fb70a205f44c9e9ed87fd322b8d1dc'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.780099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fb70a205f44c9e9ed87fd322b8d1dc'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:34.790510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1087/2148] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:34 2022] DELETE /identity/v3/users/29fb70a205f44c9e9ed87fd322b8d1dc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:34.823186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1062/2149] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:34.833257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:34.836634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:34.838063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.899322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2005424-d07e-4aad-b28f-17d628f0d6ef admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:34.902997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:34.903601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.903885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.904164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.966282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:34.967716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:34.978302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1088/2150] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:35.014490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:35.256165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.257530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:35.276185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e4cb1-1ceb-49c8-98c2-646fa4f64c88 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.282681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.283581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.283965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.284418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] PATH_INFO: `/v3/projects/721f3f1cd3794519ae9a9bd80cb25f6c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.287557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=721f3f1cd3794519ae9a9bd80cb25f6c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.290852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.421612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721f3f1cd3794519ae9a9bd80cb25f6c', 'request_id': 'req-1c07b72b-5af5-44e2-8377-1c14545afdde'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.428865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721f3f1cd3794519ae9a9bd80cb25f6c', 'request_id': 'req-1c07b72b-5af5-44e2-8377-1c14545afdde'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.440078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721f3f1cd3794519ae9a9bd80cb25f6c', 'request_id': 'req-1c07b72b-5af5-44e2-8377-1c14545afdde'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.441398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.443644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:35.468098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bcc83-0723-4e18-99c7-7f8705fc8ccf service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.526705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] The token cache is being invalidate because project 721f3f1cd3794519ae9a9bd80cb25f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:35.527001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.527657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c07b72b-5af5-44e2-8377-1c14545afdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.529390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1063/2151] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:35 2022] DELETE /identity/v3/projects/721f3f1cd3794519ae9a9bd80cb25f6c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:35.535315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9605cb-7d80-4816-83ff-9ca4852110f0 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.535674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9605cb-7d80-4816-83ff-9ca4852110f0 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.536023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9605cb-7d80-4816-83ff-9ca4852110f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.549579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.550213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.550508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.550773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] PATH_INFO: `/v3/projects/3f30405ce0b743f9a71b8133bdd5daf6` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.551896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f30405ce0b743f9a71b8133bdd5daf6)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.554526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.558445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-cc9605cb-7d80-4816-83ff-9ca4852110f0 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:35.559754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cc9605cb-7d80-4816-83ff-9ca4852110f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:35.576261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1064/2152] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:35.577853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.578150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.578425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.599389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:35.601224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:35.609373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1065/2153] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:35.613597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.623766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1ca2-ac5f-4edc-b7d3-60d44bf3c7db None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.628906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.629565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.629852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.630129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.631426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:35.632464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.634157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.647721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1066/2154] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:35.652061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.663666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8f153-67f0-47a6-a051-ff17320ab394 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.665748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f30405ce0b743f9a71b8133bdd5daf6', 'request_id': 'req-34815b91-cae8-4299-abac-02a94c36d09d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.732422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.733750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.734107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.734449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.735186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.737175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.744376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f30405ce0b743f9a71b8133bdd5daf6', 'request_id': 'req-34815b91-cae8-4299-abac-02a94c36d09d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.751399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f30405ce0b743f9a71b8133bdd5daf6', 'request_id': 'req-34815b91-cae8-4299-abac-02a94c36d09d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.763124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] The token cache is being invalidate because project 3f30405ce0b743f9a71b8133bdd5daf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:35.763422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.764091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.765949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1089/2155] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:35 2022] DELETE /identity/v3/projects/3f30405ce0b743f9a71b8133bdd5daf6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:35.769813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.771153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:35.791616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b91-cae8-4299-abac-02a94c36d09d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.797879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.799175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.799456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.799730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] PATH_INFO: `/v3/users/ba15bd42ac6241799ac991ae48e1543a` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.800872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba15bd42ac6241799ac991ae48e1543a)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.803448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.876331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1067/2156] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:35 2022] POST /identity/v3/projects => generated 391 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:35.880131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.882311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:35.953888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03eba0-c5bd-4247-90de-d4935b7ec9cd admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.959043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.959959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.960888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.961219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.961874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.963884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.987126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba15bd42ac6241799ac991ae48e1543a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.987883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba15bd42ac6241799ac991ae48e1543a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:35.995803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba15bd42ac6241799ac991ae48e1543a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.080008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1068/2157] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:35 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:36.082710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.083076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba15bd42ac6241799ac991ae48e1543a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.093618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf56d-8a23-4ddb-9f06-a37989c62f8b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.096882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba15bd42ac6241799ac991ae48e1543a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.098994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.100138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.100421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.100701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.101501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.103105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.103931 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1090/2158] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:35 2022] DELETE /identity/v3/users/ba15bd42ac6241799ac991ae48e1543a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:36.117633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1069/2159] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:36.123873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.123873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:36.199687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a134558-e344-4ba1-8175-f3ce7810fcb9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.205542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cac66-62ad-4621-bfd5-a4dbc4d19663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.206473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cac66-62ad-4621-bfd5-a4dbc4d19663 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.206862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cac66-62ad-4621-bfd5-a4dbc4d19663 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.207272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cac66-62ad-4621-bfd5-a4dbc4d19663 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.208037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cac66-62ad-4621-bfd5-a4dbc4d19663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.210421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cac66-62ad-4621-bfd5-a4dbc4d19663 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.227608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.235013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1091/2160] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:36.240677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d277437-33f8-42ed-a6a5-5e087fb13cbd admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.246792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.247461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.247759 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.248036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] PATH_INFO: `/v3/projects/19dab30c134b43b29959abc5312a543d/users/8c0810d2ff98499e9f1d80480d802299/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.263546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19dab30c134b43b29959abc5312a543d, user_id=8c0810d2ff98499e9f1d80480d802299, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.266345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.363874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1070/2161] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:36 2022] PUT /identity/v3/projects/19dab30c134b43b29959abc5312a543d/users/8c0810d2ff98499e9f1d80480d802299/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:36.380009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.380311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.380595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.413976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] MFA Rules not processed for user `8c0810d2ff98499e9f1d80480d802299`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:36.415257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:36.484541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1092/2162] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:36.489200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.548058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.549916 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:36.564327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123087-c7c8-4741-a5a7-7acded0661f2 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.571273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.571892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.572197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.572441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.573148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.575064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.623926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda9cf9-8ddb-4d76-8798-1c4f0b795b6c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.628583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.629268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.629552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.629831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] PATH_INFO: `/v3/projects/b2451e5f73284a689704909fd754c595` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.631569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2451e5f73284a689704909fd754c595)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.633618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.695321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1071/2163] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:36 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:36.699850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.751283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2451e5f73284a689704909fd754c595', 'request_id': 'req-3369e0d8-4062-4f49-ba02-e47f6842280c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.765216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200742-96b2-420c-b67c-34e3983a71d0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.826343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.827156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.827520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.827760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.828413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.830461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.837194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2451e5f73284a689704909fd754c595', 'request_id': 'req-3369e0d8-4062-4f49-ba02-e47f6842280c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.846250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2451e5f73284a689704909fd754c595', 'request_id': 'req-3369e0d8-4062-4f49-ba02-e47f6842280c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.857668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] The token cache is being invalidate because project b2451e5f73284a689704909fd754c595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:36.858052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.858731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-3369e0d8-4062-4f49-ba02-e47f6842280c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:36.860242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1093/2164] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:36 2022] DELETE /identity/v3/projects/b2451e5f73284a689704909fd754c595 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:36.865208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558707-526d-46cf-ab39-32b46cde369b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.865526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558707-526d-46cf-ab39-32b46cde369b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.869449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558707-526d-46cf-ab39-32b46cde369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.886471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-96558707-526d-46cf-ab39-32b46cde369b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:36.887701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-96558707-526d-46cf-ab39-32b46cde369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:36.896168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1094/2165] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:36.906470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.907098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.907444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.930171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:36.934522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1072/2166] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:36 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:36.939512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.941268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:36.942630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:36.944892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:36.957843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1095/2167] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:36.957999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33ab7-0917-4967-9e77-8f743e33bc72 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.959823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.963271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.965426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.965426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.965426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.965426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.967478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.969752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14961-a34c-464b-97ea-fb1f611b919c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:36.975696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:36.976332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:36.976629 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:36.977090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:36.977883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:36.978062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:36.979846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:36.981564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1073/2168] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:36.985767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:36.996535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1096/2169] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:36.997311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08380494-bc86-42c7-b51f-389d7960c1b4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.000731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.002492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.003431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.003722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.004047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] PATH_INFO: `/v3/projects/c0cfbd5b1b104ac98b37bd365c033827/users/e708c010c41e4e1c8816164c4ad44fee/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.012991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd805-2279-423e-90fa-347fd40e9251 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.017973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.018736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.019024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.019209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:37.019322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.019930 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.023005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.026283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cfbd5b1b104ac98b37bd365c033827, user_id=e708c010c41e4e1c8816164c4ad44fee, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.029125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.133612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1097/2170] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:36 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:37.134587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1074/2171] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:36 2022] PUT /identity/v3/projects/c0cfbd5b1b104ac98b37bd365c033827/users/e708c010c41e4e1c8816164c4ad44fee/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:37.134935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.135387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.197841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1a95-731b-482d-b1fe-f9aac9454ccf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.200588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827134e-90d6-49c5-915a-6050cf38c9a6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.202926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.203529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.203873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.204199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.204844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.205994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.206667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.206888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.207078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.207422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.208053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.210274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.219032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1098/2172] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:37.226733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.236594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396d6f4-431f-43fd-81c0-4c7d67bced41 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.242232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cadaba-a739-4ddd-8f65-5eb4649dff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.242873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cadaba-a739-4ddd-8f65-5eb4649dff4f admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.243163 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cadaba-a739-4ddd-8f65-5eb4649dff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.243444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cadaba-a739-4ddd-8f65-5eb4649dff4f admin admin] PATH_INFO: `/v3/projects/c0cfbd5b1b104ac98b37bd365c033827/users/e708c010c41e4e1c8816164c4ad44fee/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.245405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cadaba-a739-4ddd-8f65-5eb4649dff4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cfbd5b1b104ac98b37bd365c033827, user_id=e708c010c41e4e1c8816164c4ad44fee, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.248078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cadaba-a739-4ddd-8f65-5eb4649dff4f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.259746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1099/2173] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:37 2022] PUT /identity/v3/projects/c0cfbd5b1b104ac98b37bd365c033827/users/e708c010c41e4e1c8816164c4ad44fee/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:37.270429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.270648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.270941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.299396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1075/2174] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:37 2022] POST /identity/v3/users => generated 304 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:37.306512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] MFA Rules not processed for user `e708c010c41e4e1c8816164c4ad44fee`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:37.307557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.307985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.319011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83a26-90df-4199-877e-4291907f0031 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.385412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1100/2175] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:37.386655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.388153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.389959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.390599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.390887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.391165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.391907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.393603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.404925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89e318-6772-4e0b-badf-187c96cacd5f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.405803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1076/2176] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:37.411021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.411021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.413773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.414433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.414720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.415005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] PATH_INFO: `/v3/users/a0a598ea0a984548b508bd583d311d31` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.416187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a598ea0a984548b508bd583d311d31)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.418183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.469002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa23f-3d40-45d9-b45d-c74cd3ef950b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.472826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.473533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.473916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.474219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.483645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.485116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.495248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1077/2177] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:37.496096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.506713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632e91-b14e-466a-a2c0-85c408f0702b service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.520851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.522439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.522730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.523006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.523685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.525464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.539450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1078/2178] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:37.540918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.569561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb156f-99ad-4736-b06b-5ff8fc4abc72 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.573038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.573721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.574006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.574289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] PATH_INFO: `/v3/projects/85e3ce6cfbb0484f86086fc8e9d793f3/users/142b66a42a354fa9bf553423339027c9/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.590474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e3ce6cfbb0484f86086fc8e9d793f3, user_id=142b66a42a354fa9bf553423339027c9, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.593232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.635109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a598ea0a984548b508bd583d311d31'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:37.635964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a598ea0a984548b508bd583d311d31'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:37.645438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a598ea0a984548b508bd583d311d31'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:37.682842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1079/2179] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:37 2022] PUT /identity/v3/projects/85e3ce6cfbb0484f86086fc8e9d793f3/users/142b66a42a354fa9bf553423339027c9/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:37.692799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.748379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e403-39fd-4c85-b369-b53908a9a670 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.752034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.752650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.752955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.753247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.755043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.759811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a598ea0a984548b508bd583d311d31'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:37.773973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-336a065e-8291-41c3-aa99-9feabb52370d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a598ea0a984548b508bd583d311d31'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:37.780017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1101/2180] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:37 2022] DELETE /identity/v3/users/a0a598ea0a984548b508bd583d311d31 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:37.781289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.781578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.781855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.812929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] MFA Rules not processed for user `142b66a42a354fa9bf553423339027c9`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:37.814285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.819086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:37.821084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78ae0-3f11-41bc-af98-68864a219a1f service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:37.830580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1080/2181] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:37.831850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.832141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.832420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.852011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:37.853315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.900753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1102/2182] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:37.902090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.905096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.928420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1081/2183] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:37.938533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:37.939953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.990764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1fca-e293-41b4-b9dd-e6dce3a7cdf2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:37.996581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:37.997266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.997555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.997830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.998796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.000727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.012845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f09899-3ef8-4f29-9b8b-7ea659feac1f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.017727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.018429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.018903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.019186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.030071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.031503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.041916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1082/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:38.098678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1103/2185] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:37 2022] POST /identity/v3/projects => generated 409 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:38.100895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.114874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d794c93-6b66-4992-8a9f-da00f95c60a2 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.199291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.200001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.201038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.201814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.202242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.205192 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.314846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1083/2186] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:38 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:38.319310 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.330260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783ce85-ef47-4978-b97b-98962f83709b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.335249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.335756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.336245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.336713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.337605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.339428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.352998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1104/2187] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:38.355686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.370730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ed285-a24e-49e6-8910-be3fc7c84a63 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.374155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.375228 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.375544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.375925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] PATH_INFO: `/v3/projects/b1745f5261754becb333eb8f05549f10/users/63aa751229db495f99258985b06a0882/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.393826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1745f5261754becb333eb8f05549f10, user_id=63aa751229db495f99258985b06a0882, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.397200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.518054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1084/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:38 2022] PUT /identity/v3/projects/b1745f5261754becb333eb8f05549f10/users/63aa751229db495f99258985b06a0882/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:38.522249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.533013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8784f-279d-43b9-a58c-65b176e4440b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.556779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:38.601962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.602588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.603247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.603362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.604023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.605648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.621369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1105/2189] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:38.621708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.635257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40519c-f85a-4fff-ab02-0e3b0949d7d5 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.640332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ae83-f3ef-4967-ba13-24953225ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.641092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ae83-f3ef-4967-ba13-24953225ec63 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.641379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ae83-f3ef-4967-ba13-24953225ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.641655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ae83-f3ef-4967-ba13-24953225ec63 admin admin] PATH_INFO: `/v3/projects/b1745f5261754becb333eb8f05549f10/users/63aa751229db495f99258985b06a0882/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.643655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3ae83-f3ef-4967-ba13-24953225ec63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1745f5261754becb333eb8f05549f10, user_id=63aa751229db495f99258985b06a0882, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.650248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3ae83-f3ef-4967-ba13-24953225ec63 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.653035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.654885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:38.661125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1085/2190] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:38 2022] PUT /identity/v3/projects/b1745f5261754becb333eb8f05549f10/users/63aa751229db495f99258985b06a0882/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:38.668095 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185ac36-6cf3-40cc-a0d8-c6c3290c6f4f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.675674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.676029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.676682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.713989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] MFA Rules not processed for user `63aa751229db495f99258985b06a0882`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:38.715417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:38.742849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.743741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.744034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.744369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] PATH_INFO: `/v3/projects/02b7f4755a2249c79ad8013de035b908` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.745626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b7f4755a2249c79ad8013de035b908)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.747701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.758339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:38.795600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1086/2191] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:38.807622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.809021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:38.861278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b7f4755a2249c79ad8013de035b908', 'request_id': 'req-d2f450f6-5dab-4458-bd38-6e2dc962b77d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:38.870194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086dea6-f75c-4039-92a3-b64aa4099d2c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.918507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.919041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.919322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.919595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.946020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b7f4755a2249c79ad8013de035b908', 'request_id': 'req-d2f450f6-5dab-4458-bd38-6e2dc962b77d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:38.954839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b7f4755a2249c79ad8013de035b908', 'request_id': 'req-d2f450f6-5dab-4458-bd38-6e2dc962b77d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:38.967737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] The token cache is being invalidate because project 02b7f4755a2249c79ad8013de035b908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:38.968071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:38.968867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:38.973444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1106/2192] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:38 2022] DELETE /identity/v3/projects/02b7f4755a2249c79ad8013de035b908 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:38.974442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.976403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:38.988990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.991133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:39.000710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1087/2193] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:38 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:39.043538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f450f6-5dab-4458-bd38-6e2dc962b77d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:39.048656 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:39.054365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:39.054365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:39.054365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] PATH_INFO: `/v3/users/60585460f2974d6f8d322d5ef2277bfe` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:39.054365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60585460f2974d6f8d322d5ef2277bfe)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:39.054365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:39.247249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60585460f2974d6f8d322d5ef2277bfe'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:39.248121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60585460f2974d6f8d322d5ef2277bfe'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:39.255563 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60585460f2974d6f8d322d5ef2277bfe'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:39.361880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60585460f2974d6f8d322d5ef2277bfe'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:39.376322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60585460f2974d6f8d322d5ef2277bfe'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:39.383676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1107/2194] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:38 2022] DELETE /identity/v3/users/60585460f2974d6f8d322d5ef2277bfe => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:39.524195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:39.533010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234009f7-cddf-4def-9a79-61483443e586 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:39.586660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:39.587473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:39.587760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:39.588037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:39.590036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:39.662429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:39.664149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:39.673745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1088/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:39.838605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:39.840102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:39.914520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791a4ef-fd6a-4120-96fd-cafe6af823e4 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:39.921266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:39.922128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:39.922417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:39.922822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] PATH_INFO: `/v3/projects/52e18c8190e74cb5b3880b74582622e2` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:39.923970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e18c8190e74cb5b3880b74582622e2)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:39.926330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:40.034453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e18c8190e74cb5b3880b74582622e2', 'request_id': 'req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.139151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e18c8190e74cb5b3880b74582622e2', 'request_id': 'req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.148153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e18c8190e74cb5b3880b74582622e2', 'request_id': 'req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.158003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] The token cache is being invalidate because project 52e18c8190e74cb5b3880b74582622e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:40.158366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.159082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.160657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1108/2196] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:39 2022] DELETE /identity/v3/projects/52e18c8190e74cb5b3880b74582622e2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:40.165008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:40.175801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d1c99-343b-4870-8827-91cf4adf1988 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:40.233712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:40.234350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:40.234689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:40.234969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] PATH_INFO: `/v3/users/db1f67eccd324251a6d16187e13c7d19` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:40.236121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1f67eccd324251a6d16187e13c7d19)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:40.238090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:40.267708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:40.467245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:40.481987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1f67eccd324251a6d16187e13c7d19'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.489542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1f67eccd324251a6d16187e13c7d19'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.491340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1f67eccd324251a6d16187e13c7d19'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.491671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1f67eccd324251a6d16187e13c7d19'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.600464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-c319e082-49fd-4219-9baa-611c27c92d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1f67eccd324251a6d16187e13c7d19'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:40.619074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1089/2197] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:40 2022] DELETE /identity/v3/users/db1f67eccd324251a6d16187e13c7d19 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:41.009936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.011585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.026760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6fe6-360d-4b2c-ab65-7c50a5567225 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.095948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.096594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.096881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.097317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] PATH_INFO: `/v3/projects/ba1f6a3fc61a44ef94f036b39ea67ffa` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.098552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1f6a3fc61a44ef94f036b39ea67ffa)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.100606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.226121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1f6a3fc61a44ef94f036b39ea67ffa', 'request_id': 'req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.292286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1f6a3fc61a44ef94f036b39ea67ffa', 'request_id': 'req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.306502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1f6a3fc61a44ef94f036b39ea67ffa', 'request_id': 'req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.323484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] The token cache is being invalidate because project ba1f6a3fc61a44ef94f036b39ea67ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:41.323787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.324485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18cc8987-82df-4a59-a4f3-6cb34e8f0a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:41.326576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1109/2198] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:41 2022] DELETE /identity/v3/projects/ba1f6a3fc61a44ef94f036b39ea67ffa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:41.331456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.332026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.332529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.353857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:41.355383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.423719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1090/2199] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:41.432123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80564da9-c377-4473-952e-9205a835ac35 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.432492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80564da9-c377-4473-952e-9205a835ac35 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.432850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80564da9-c377-4473-952e-9205a835ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.454866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-80564da9-c377-4473-952e-9205a835ac35 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:41.456263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-80564da9-c377-4473-952e-9205a835ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.465493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1110/2200] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:41.469782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.481634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b7600-4bec-4ea3-bd5f-c6654d8b184d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.486851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.487474 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.487761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.488041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.488769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:41.489077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.491649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.504720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1091/2201] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:41.512875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80564da9-c377-4473-952e-9205a835ac35 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.523200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80564da9-c377-4473-952e-9205a835ac35 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.528658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.529313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.529667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.530522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.531058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.533527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.656605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1111/2202] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/projects => generated 397 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:41.657908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.667953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e68f-8511-4d36-aa4c-edd5f5313dbb admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.731694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.732348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.732637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.733058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.733773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.735679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.826082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1092/2203] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:41.830162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.843456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9c1b-640c-44f0-9a53-eb5723aac4a6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.849522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.850695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.851043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.851341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.852009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.853729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.864661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1112/2204] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:41.869142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.879249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1b85-9fcf-48ae-ae24-bb5aa3dfbccc admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.884181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7335b46-27a7-4358-b8b6-b06e320e7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.884796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335b46-27a7-4358-b8b6-b06e320e7d5c admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.885125 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335b46-27a7-4358-b8b6-b06e320e7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.885406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335b46-27a7-4358-b8b6-b06e320e7d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.886062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7335b46-27a7-4358-b8b6-b06e320e7d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.887669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7335b46-27a7-4358-b8b6-b06e320e7d5c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:41.898450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1093/2205] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:41.902517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.913720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94376639-7399-4f43-8764-0b5481b5d968 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.919699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.920512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.920839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.921112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] PATH_INFO: `/v3/projects/ed9acbb4e0e04e5c918880501bc9c98f/users/2546085103d045f4b042e47a2f068517/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.939647 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9acbb4e0e04e5c918880501bc9c98f, user_id=2546085103d045f4b042e47a2f068517, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:41.942271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.051367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.066283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1113/2206] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:41 2022] PUT /identity/v3/projects/ed9acbb4e0e04e5c918880501bc9c98f/users/2546085103d045f4b042e47a2f068517/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:42.087287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.087575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.088046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.120797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] MFA Rules not processed for user `2546085103d045f4b042e47a2f068517`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:42.122074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.133670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.249941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1094/2207] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:42.274342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.276289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.341593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1571905-71b3-4482-ba34-1bd5ec19219b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.345768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd437f8a-1a11-4e3f-b795-4092e58c1231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.346662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437f8a-1a11-4e3f-b795-4092e58c1231 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.352015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437f8a-1a11-4e3f-b795-4092e58c1231 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.352015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd437f8a-1a11-4e3f-b795-4092e58c1231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.362574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd437f8a-1a11-4e3f-b795-4092e58c1231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.364348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd437f8a-1a11-4e3f-b795-4092e58c1231 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.375603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1114/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:43.507999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.510466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:43.587375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3043-d991-4fb8-813a-2eb97d6e438a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.591963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.592597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.592879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.595911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] PATH_INFO: `/v3/users/8c0810d2ff98499e9f1d80480d802299` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.595911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0810d2ff98499e9f1d80480d802299)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.596187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.676710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.802210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0810d2ff98499e9f1d80480d802299'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.810719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0810d2ff98499e9f1d80480d802299'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.811449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0810d2ff98499e9f1d80480d802299'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.812075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0810d2ff98499e9f1d80480d802299'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.869602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0810d2ff98499e9f1d80480d802299'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:43.891018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1095/2209] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:43 2022] DELETE /identity/v3/users/8c0810d2ff98499e9f1d80480d802299 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:43.897698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.897974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.905610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.917414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:43.918641 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:43.987081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1115/2210] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:43.999052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.000667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:44.079032 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dc57d-66db-4bb9-9227-0ff51c392017 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.085491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.086221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.087368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.087608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.097832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.099367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.110599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1096/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:44.386306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:44.558761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.560316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:44.574835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c3ba-6103-4a36-b64c-949567a59a2f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.580073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.580980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.581283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.581554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] PATH_INFO: `/v3/projects/19dab30c134b43b29959abc5312a543d` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.582717 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19dab30c134b43b29959abc5312a543d)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.585026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.700852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19dab30c134b43b29959abc5312a543d', 'request_id': 'req-a7ce6309-1e88-4dff-93d5-4005f660da45'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:44.762152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19dab30c134b43b29959abc5312a543d', 'request_id': 'req-a7ce6309-1e88-4dff-93d5-4005f660da45'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:44.769074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19dab30c134b43b29959abc5312a543d', 'request_id': 'req-a7ce6309-1e88-4dff-93d5-4005f660da45'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:44.779465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] The token cache is being invalidate because project 19dab30c134b43b29959abc5312a543d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:44.779758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:44.780391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:44.781908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1116/2212] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:44 2022] DELETE /identity/v3/projects/19dab30c134b43b29959abc5312a543d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:44.786057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.797946 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2e5fd-cc2b-4c5e-a9e1-8f893b5f7eed service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.861506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.862170 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.862484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.862767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] PATH_INFO: `/v3/users/e708c010c41e4e1c8816164c4ad44fee` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.864283 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e708c010c41e4e1c8816164c4ad44fee)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.867286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:45.067389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e708c010c41e4e1c8816164c4ad44fee'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.074881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e708c010c41e4e1c8816164c4ad44fee'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.075602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e708c010c41e4e1c8816164c4ad44fee'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.076218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e708c010c41e4e1c8816164c4ad44fee'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.184707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7d31e182-b473-443a-9055-4f27561a9b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e708c010c41e4e1c8816164c4ad44fee'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:45.203054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1097/2213] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:44 2022] DELETE /identity/v3/users/e708c010c41e4e1c8816164c4ad44fee => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:45.478269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:45.960956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:45.965922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:45.983354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce6309-1e88-4dff-93d5-4005f660da45 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.059634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.060288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.060610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.060895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] PATH_INFO: `/v3/projects/c0cfbd5b1b104ac98b37bd365c033827` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.062111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cfbd5b1b104ac98b37bd365c033827)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.064039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.151006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.199080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cfbd5b1b104ac98b37bd365c033827', 'request_id': 'req-7963983e-0262-4755-9195-6d7fb41def2a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:46.287888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cfbd5b1b104ac98b37bd365c033827', 'request_id': 'req-7963983e-0262-4755-9195-6d7fb41def2a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:46.300050 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cfbd5b1b104ac98b37bd365c033827', 'request_id': 'req-7963983e-0262-4755-9195-6d7fb41def2a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:46.312484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] The token cache is being invalidate because project c0cfbd5b1b104ac98b37bd365c033827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:46.312782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:46.313477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7963983e-0262-4755-9195-6d7fb41def2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:46.315026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1117/2214] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:45 2022] DELETE /identity/v3/projects/c0cfbd5b1b104ac98b37bd365c033827 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:46.322459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.322905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.323227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.346062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.347301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.411437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1098/2215] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:46.420174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.420466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.420774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.441299 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.442524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.451371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1118/2216] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:46.455756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.466193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82826e-3950-4f53-9a8a-054f7978dd8f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.470883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.471485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.471772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.472052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.472765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:46.473104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.474781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.487582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1099/2217] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:46.492504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.501718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0102-90ab-439a-9ddb-ec76caf8ae33 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.507715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.508207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.508497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.508900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.509474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.511411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.596035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.605340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1119/2218] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:46.607739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.618132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16347d-9ea9-472e-b045-d62dc3417a8f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.681406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.682206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.682875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.682875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.683656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.685789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.698453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.841068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1100/2219] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:46.845399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.856289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc456e-4009-4e0b-87cf-fffd65e5198b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.862888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.863517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.863949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.864377 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.865066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.867502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.880075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1120/2220] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:46.884383 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.895633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b29aca-36a8-40e3-ae26-3fe36068e126 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.903193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417744-4732-42eb-b250-91f56088e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.903851 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417744-4732-42eb-b250-91f56088e44b admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.904138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417744-4732-42eb-b250-91f56088e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.908771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417744-4732-42eb-b250-91f56088e44b admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.908771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417744-4732-42eb-b250-91f56088e44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.908771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417744-4732-42eb-b250-91f56088e44b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:46.918112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1101/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:46.925631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.936798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ba92-9ceb-4b65-a220-af1d13587878 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.941755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.942427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.942712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.942992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] PATH_INFO: `/v3/projects/e9b66f6119f54fbba8bc49a404eea18d/users/e7993fa146e342b689f462ac0eaac213/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.959823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b66f6119f54fbba8bc49a404eea18d, user_id=e7993fa146e342b689f462ac0eaac213, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:46.962894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.046782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1121/2222] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:46 2022] PUT /identity/v3/projects/e9b66f6119f54fbba8bc49a404eea18d/users/e7993fa146e342b689f462ac0eaac213/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:47.058752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.059043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.059329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.097237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] MFA Rules not processed for user `e7993fa146e342b689f462ac0eaac213`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:47.098447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.168296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1102/2223] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:47.173013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.236016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4d0f-aa9f-4ee7-b27c-8044585888f9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.241736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.242347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.242637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.242922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.243592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.245628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.339830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1122/2224] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:47.340573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.354282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e89c5-ccdb-4fb1-840a-1471f7265383 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.402312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.404730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.455019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.455993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.456450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.456907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.458039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.461619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.501361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52ec6-de6b-45a1-a003-a54939e94c71 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.507972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.507972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.507972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.508332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] PATH_INFO: `/v3/users/142b66a42a354fa9bf553423339027c9` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.509441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142b66a42a354fa9bf553423339027c9)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.511396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.596620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1103/2225] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:47.600617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.611073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18618-cbc8-4e91-a05a-c70028eac132 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.616295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.617124 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.617413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.617738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.618387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.620105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.630917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1104/2226] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:47.632574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.634704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.644705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2c082-f561-442d-8ffb-ce355372d60d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.654094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.654712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.655026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.655359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.656015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.657747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.671012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1105/2227] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:47.676417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.686662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00805f-d44e-4cda-9462-7d979a244a7a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.691373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7744a-4233-4d0f-85fc-501c30ac2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.692145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7744a-4233-4d0f-85fc-501c30ac2d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.692387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7744a-4233-4d0f-85fc-501c30ac2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.692665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7744a-4233-4d0f-85fc-501c30ac2d03 admin admin] PATH_INFO: `/v3/projects/1c115f63ee4341daa800ff6cf6004c77/users/8988bff819c04c3c93df2a0e8595732a/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.707966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7744a-4233-4d0f-85fc-501c30ac2d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c115f63ee4341daa800ff6cf6004c77, user_id=8988bff819c04c3c93df2a0e8595732a, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.711343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d7744a-4233-4d0f-85fc-501c30ac2d03 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.728577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142b66a42a354fa9bf553423339027c9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:47.729268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142b66a42a354fa9bf553423339027c9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:47.737118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142b66a42a354fa9bf553423339027c9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:47.802476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1106/2228] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:47 2022] PUT /identity/v3/projects/1c115f63ee4341daa800ff6cf6004c77/users/8988bff819c04c3c93df2a0e8595732a/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:47.814149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.814441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.814728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.824623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142b66a42a354fa9bf553423339027c9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:47.838440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-f025a8a6-f6e3-4e5a-b4fa-fd77d27151e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142b66a42a354fa9bf553423339027c9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:47.845697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] MFA Rules not processed for user `8988bff819c04c3c93df2a0e8595732a`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:47.847152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1123/2229] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:47 2022] DELETE /identity/v3/users/142b66a42a354fa9bf553423339027c9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:47.847265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.851429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.851777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.852086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.873232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:47.874955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.894612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.919894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1107/2230] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:47.925953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.926615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.940267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1124/2231] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:47.953359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.954820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.001594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfebbf-599a-4b92-841d-df6672729d5c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.007458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.008223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.008522 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.008800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.009478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.011405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.026189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f1009-3b89-4b36-8f9e-a14acffc9696 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.031408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.032170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.032531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.032883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.044664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.046267 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.054291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.057173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1125/2232] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:48.136267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1108/2233] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:48.137364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.149756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071acc3-f387-4359-a7bb-a54999583317 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.215678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.216448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.216817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.217133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.217794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.219739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.345633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.347325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.360841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142763de-db92-4e19-8f40-04b22a05a0e3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.366199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.366893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.367185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.367473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] PATH_INFO: `/v3/users/2546085103d045f4b042e47a2f068517` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.368694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2546085103d045f4b042e47a2f068517)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.370901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.390048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1126/2234] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:48 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:48.395887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.409809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af56fee-3e94-4153-8671-c138344903c7 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.417981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.418749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.419038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.419320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.419980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.421672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.435395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1127/2235] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:48.440677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.452135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15116f-6405-45be-9a81-d4472074aab4 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.457444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.458181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.458546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.458919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] PATH_INFO: `/v3/projects/e7127b22a5254296b3923522e9e14488/users/6c627fc69d0643529096a132acfa227d/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.475759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7127b22a5254296b3923522e9e14488, user_id=6c627fc69d0643529096a132acfa227d, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.478577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.601487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1128/2236] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:48 2022] PUT /identity/v3/projects/e7127b22a5254296b3923522e9e14488/users/6c627fc69d0643529096a132acfa227d/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:48.602356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.604056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.677035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2546085103d045f4b042e47a2f068517'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.681472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9375-2c70-4efb-ae37-239f434a5b33 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.685966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2546085103d045f4b042e47a2f068517'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.686730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2546085103d045f4b042e47a2f068517'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.687347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2546085103d045f4b042e47a2f068517'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.692526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.693218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.693576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.696473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] PATH_INFO: `/v3/projects/85e3ce6cfbb0484f86086fc8e9d793f3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.696473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e3ce6cfbb0484f86086fc8e9d793f3)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.697453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.732260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.761941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2546085103d045f4b042e47a2f068517'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.781990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1109/2237] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:48 2022] DELETE /identity/v3/users/2546085103d045f4b042e47a2f068517 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:48.782959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.784789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.795096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.824991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e3ce6cfbb0484f86086fc8e9d793f3', 'request_id': 'req-69796804-0a80-4b4f-8233-dd9d93dd16bb'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.867985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c44b8-85e0-4f00-9e95-fd60f042eba9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.908887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e3ce6cfbb0484f86086fc8e9d793f3', 'request_id': 'req-69796804-0a80-4b4f-8233-dd9d93dd16bb'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.917773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e3ce6cfbb0484f86086fc8e9d793f3', 'request_id': 'req-69796804-0a80-4b4f-8233-dd9d93dd16bb'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.929239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] The token cache is being invalidate because project 85e3ce6cfbb0484f86086fc8e9d793f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:48.929534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.929729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.935282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-69796804-0a80-4b4f-8233-dd9d93dd16bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:48.935392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.935392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.935392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.935392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.935663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1129/2238] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:48 2022] DELETE /identity/v3/projects/85e3ce6cfbb0484f86086fc8e9d793f3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:48.935663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.935663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.935842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.935934 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.945790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1110/2239] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:48.945979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.948252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.955466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:48.956677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.962929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f1ad0-56f7-4963-b336-75953f06c3e7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.965907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1130/2240] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:48.966831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.968081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.971463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.972105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.972389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.972669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] PATH_INFO: `/v3/users/63aa751229db495f99258985b06a0882` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.973849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63aa751229db495f99258985b06a0882)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.976753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.981099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9295-26e6-4c31-b17d-57fbfbf937d6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.989030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.991114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.991483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.991775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] PATH_INFO: `/v3/projects/e7127b22a5254296b3923522e9e14488/users/6c627fc69d0643529096a132acfa227d/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.995900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7127b22a5254296b3923522e9e14488, user_id=6c627fc69d0643529096a132acfa227d, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.998695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.012240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1131/2241] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:48 2022] PUT /identity/v3/projects/e7127b22a5254296b3923522e9e14488/users/6c627fc69d0643529096a132acfa227d/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:49.013129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.014731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.077238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7174-5164-4249-b02a-f6bbb3a4e9f3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.081089 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c85138-7513-4338-9984-9738dfb660d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.081701 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85138-7513-4338-9984-9738dfb660d3 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.081989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85138-7513-4338-9984-9738dfb660d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.082272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85138-7513-4338-9984-9738dfb660d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.134688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63aa751229db495f99258985b06a0882'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:49.141653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63aa751229db495f99258985b06a0882'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:49.142346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63aa751229db495f99258985b06a0882'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:49.142984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63aa751229db495f99258985b06a0882'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:49.145316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85138-7513-4338-9984-9738dfb660d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.147307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85138-7513-4338-9984-9738dfb660d3 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.157835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1132/2242] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:49.159303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.159534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.159822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.177866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.191432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] MFA Rules not processed for user `6c627fc69d0643529096a132acfa227d`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:49.192838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.207676 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63aa751229db495f99258985b06a0882'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:49.231961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1111/2243] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:48 2022] DELETE /identity/v3/users/63aa751229db495f99258985b06a0882 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:49.237921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.269578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1133/2244] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:49.282683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.285646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.360773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147823-64a6-4fbd-b4cc-1cbf12087f3d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.363855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.364528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.364815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.365139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.432225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.437156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.444745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1112/2245] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:49.564736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.566386 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.634752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.641167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9708a2b-b579-4783-af3d-3e37e4bae221 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.647247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.647874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.648161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.648445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.650221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.712201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.713687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.722712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1134/2246] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:49.727353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.729052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.815057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ea555-4138-4e2f-9725-554daa33894e service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.821883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.823643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:49.831392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.832059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.832318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.832592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] PATH_INFO: `/v3/projects/ed9acbb4e0e04e5c918880501bc9c98f` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.834774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9acbb4e0e04e5c918880501bc9c98f)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.836849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.841999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9570597-4cdb-47fd-8522-05dc977d0623 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.856858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.857581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.857954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.858354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] PATH_INFO: `/v3/projects/b1745f5261754becb333eb8f05549f10` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.859611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1745f5261754becb333eb8f05549f10)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.861679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.023741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1745f5261754becb333eb8f05549f10', 'request_id': 'req-e694f571-0dfb-4777-be74-b25bb4560f04'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.024007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9acbb4e0e04e5c918880501bc9c98f', 'request_id': 'req-1fed2105-2388-4600-b732-a1db6de435ac'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.030605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9acbb4e0e04e5c918880501bc9c98f', 'request_id': 'req-1fed2105-2388-4600-b732-a1db6de435ac'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.036840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9acbb4e0e04e5c918880501bc9c98f', 'request_id': 'req-1fed2105-2388-4600-b732-a1db6de435ac'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.099343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1745f5261754becb333eb8f05549f10', 'request_id': 'req-e694f571-0dfb-4777-be74-b25bb4560f04'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.106954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1745f5261754becb333eb8f05549f10', 'request_id': 'req-e694f571-0dfb-4777-be74-b25bb4560f04'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.119653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] The token cache is being invalidate because project b1745f5261754becb333eb8f05549f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:50.119954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.121867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e694f571-0dfb-4777-be74-b25bb4560f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.123429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1135/2247] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:49 2022] DELETE /identity/v3/projects/b1745f5261754becb333eb8f05549f10 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:50.128160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f6cd-7a80-4e94-9b80-2c477d5fa933 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.128458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f6cd-7a80-4e94-9b80-2c477d5fa933 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.128745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f6cd-7a80-4e94-9b80-2c477d5fa933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.151532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-34d2f6cd-7a80-4e94-9b80-2c477d5fa933 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.152769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-34d2f6cd-7a80-4e94-9b80-2c477d5fa933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.173271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] The token cache is being invalidate because project ed9acbb4e0e04e5c918880501bc9c98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:50.173488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.174143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1fed2105-2388-4600-b732-a1db6de435ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:50.175624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1113/2248] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:49 2022] DELETE /identity/v3/projects/ed9acbb4e0e04e5c918880501bc9c98f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:50.181099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233aeb9-cce1-4a81-a3de-66dbb7c0f0ba None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.181380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233aeb9-cce1-4a81-a3de-66dbb7c0f0ba None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.181654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233aeb9-cce1-4a81-a3de-66dbb7c0f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.201998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2233aeb9-cce1-4a81-a3de-66dbb7c0f0ba None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.205686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2233aeb9-cce1-4a81-a3de-66dbb7c0f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.219045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1136/2249] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:50.227329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.227696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.228041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.249108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.250373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.259983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1137/2250] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:50.264486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.271239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1114/2251] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:50.276040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef4a7e-7397-4074-b92c-705f75c64a9b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.279597 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.279888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.280167 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.280865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.281610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.281959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.282304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.283066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:50.283441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.285218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.299203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1138/2252] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:50.301322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.302630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.303897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.311077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1115/2253] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:50.314214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0ab99-fd46-45ab-a56d-6f2addf4a46b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.315716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.322712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.323337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.323623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.323904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.324551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.326403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce4b2a-cb1b-4513-9dd2-d8e78d30fa82 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.326524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.331034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.331641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.332099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.332213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.332808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:50.333466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.335062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.348967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1116/2254] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:50.352682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.369720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc3d9d-fb91-4931-9754-095fe61186e1 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.372832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.373471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.373752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.374027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.374977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.376584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.436719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1139/2255] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:50.440501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.480485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:50.507759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23a522-ae5b-485d-a203-f6442272d78d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.512581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.513347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.513590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.513880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.514525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.516470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.536988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1117/2256] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:50.539286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.605598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3297d-db87-4504-8116-9b74dd79a66d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.610405 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.611034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.611325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.611613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.612260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.614301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.642410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:50.648811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1140/2257] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:50.653497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.666515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12b00-82a5-437b-b311-c46008afc170 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.671436 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.672137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.672490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.672867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.673642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.676418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.689160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1141/2258] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:50.691625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.705218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4e306-3380-4de9-8920-9d7a178c6d23 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.710821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.711450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.711740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.712027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.712686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.714375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.720052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1118/2259] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:50.726773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.727062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1142/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:50.730813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.739756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8354c-b436-4176-bbd6-bc159db69d80 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.741596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44324-c603-4d1b-9ba1-9ecc1c27cfd3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.745792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.746505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.746632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc372d6-8450-4eee-82e0-28c460033c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.746839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.747568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.748273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.749121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc372d6-8450-4eee-82e0-28c460033c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.749557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc372d6-8450-4eee-82e0-28c460033c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.749877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc372d6-8450-4eee-82e0-28c460033c25 admin admin] PATH_INFO: `/v3/projects/65f16859b98f4cae9dce0d662d87e657/users/cb87fa1b0b0043689c1333264e71c2e0/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.750053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.762116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1119/2261] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:50.769273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.776240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc372d6-8450-4eee-82e0-28c460033c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f16859b98f4cae9dce0d662d87e657, user_id=cb87fa1b0b0043689c1333264e71c2e0, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.778967 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc372d6-8450-4eee-82e0-28c460033c25 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.780072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064ace2-bfda-4ce1-b31a-96287f1c2da9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.785377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.785992 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.786281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.786562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.787888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.789700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.801846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1120/2262] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:50.806046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.817460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c6783-868d-4858-a8d1-43fb053739cb admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.822526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082275-ddca-43ba-a461-83aeb6107fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.823345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082275-ddca-43ba-a461-83aeb6107fac admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.823674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082275-ddca-43ba-a461-83aeb6107fac admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.824060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082275-ddca-43ba-a461-83aeb6107fac admin admin] PATH_INFO: `/v3/projects/04224c1604d04d06895ccfb8230f0f7d/users/09fad5976c834572bbf835c9193132b6/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.853055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a082275-ddca-43ba-a461-83aeb6107fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=04224c1604d04d06895ccfb8230f0f7d, user_id=09fad5976c834572bbf835c9193132b6, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.855817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a082275-ddca-43ba-a461-83aeb6107fac admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.867075 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1143/2263] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:50 2022] PUT /identity/v3/projects/65f16859b98f4cae9dce0d662d87e657/users/cb87fa1b0b0043689c1333264e71c2e0/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:50.877338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.877634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.877919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.914398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] MFA Rules not processed for user `cb87fa1b0b0043689c1333264e71c2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.915675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.934548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1121/2264] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:50 2022] PUT /identity/v3/projects/04224c1604d04d06895ccfb8230f0f7d/users/09fad5976c834572bbf835c9193132b6/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:50.942568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.942568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.942568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.979176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.980534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.007586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1144/2265] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:51.012490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.047370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1122/2266] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:51.057673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.059285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.079693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c174c3-47ea-40e8-b317-cd03ec1dc00b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.085039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.085655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.085943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.086321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.086906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.088893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.118255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aff854-726e-4208-b4c9-763ba3ccba38 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.122990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.123652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.124166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.124450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.135402 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.136848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.146735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1123/2267] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:51.187076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1145/2268] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:51 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:51.194863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.204898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21ccb-71ba-40ee-958b-f8658b48eb3a service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.263571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.264200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.264646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.264964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.265665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.267616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.363455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1124/2269] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:51 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:51.364711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.376022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7807ce-3a6d-4e82-893f-fdff33fa4e49 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.380705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.381903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.386965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.386965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.386965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.386965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.404293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1146/2270] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:51.410045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.422820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be2472-837e-40e6-85b4-f7bc6215e9d9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.427908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.429044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.429367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.429647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] PATH_INFO: `/v3/projects/9778dbae4d8d4f15b93db4363b5865f3/users/5bd442e7dc0b4228b28b6d30ab897a01/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.445543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9778dbae4d8d4f15b93db4363b5865f3, user_id=5bd442e7dc0b4228b28b6d30ab897a01, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.448807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.547045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1125/2271] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:51 2022] PUT /identity/v3/projects/9778dbae4d8d4f15b93db4363b5865f3/users/5bd442e7dc0b4228b28b6d30ab897a01/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:51.551018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.563936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf236-e72a-473b-bc4f-280ad25d18f5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.622795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d2d2-e0bd-4e73-a91c-3efdd7acdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.623415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d2d2-e0bd-4e73-a91c-3efdd7acdbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.623702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d2d2-e0bd-4e73-a91c-3efdd7acdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.623983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d2d2-e0bd-4e73-a91c-3efdd7acdbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.624634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d2d2-e0bd-4e73-a91c-3efdd7acdbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.626287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d2d2-e0bd-4e73-a91c-3efdd7acdbc9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.640422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1147/2272] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:51.644590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.654949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c6cd-fbc2-4572-a9e8-78ee82d14bf3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.659627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.660281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.660565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.660846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] PATH_INFO: `/v3/projects/9778dbae4d8d4f15b93db4363b5865f3/users/5bd442e7dc0b4228b28b6d30ab897a01/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.663433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9778dbae4d8d4f15b93db4363b5865f3, user_id=5bd442e7dc0b4228b28b6d30ab897a01, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.666252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.678625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1126/2273] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:51 2022] PUT /identity/v3/projects/9778dbae4d8d4f15b93db4363b5865f3/users/5bd442e7dc0b4228b28b6d30ab897a01/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:51.689575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.689909 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.690288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.737188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] MFA Rules not processed for user `5bd442e7dc0b4228b28b6d30ab897a01`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:51.738594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.796854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:51.855263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:51.861966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1148/2274] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:51.873447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.875206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.942820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88925f-e284-4b3a-bd9c-c8c8fba77a96 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.948465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086edec-a003-4672-8ed0-aa4584c1ebab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.949225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086edec-a003-4672-8ed0-aa4584c1ebab service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.949541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086edec-a003-4672-8ed0-aa4584c1ebab service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.949821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086edec-a003-4672-8ed0-aa4584c1ebab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.024906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086edec-a003-4672-8ed0-aa4584c1ebab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.024906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086edec-a003-4672-8ed0-aa4584c1ebab service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.024906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1127/2275] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:52.852088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.872499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.906598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.937112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339e501-0a34-4427-bd5b-9d15a2980241 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.948834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.949550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.949835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.950115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] PATH_INFO: `/v3/users/cb87fa1b0b0043689c1333264e71c2e0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.952506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb87fa1b0b0043689c1333264e71c2e0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.954493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:53.212795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb87fa1b0b0043689c1333264e71c2e0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:53.228653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb87fa1b0b0043689c1333264e71c2e0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:53.243497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb87fa1b0b0043689c1333264e71c2e0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:53.326365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb87fa1b0b0043689c1333264e71c2e0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:53.340365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb87fa1b0b0043689c1333264e71c2e0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:53.346654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1149/2276] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:52 2022] DELETE /identity/v3/users/cb87fa1b0b0043689c1333264e71c2e0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:53.351498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.351712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.351990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.373502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:53.375212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:53.454470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1128/2277] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:53.465214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:53.466721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:53.536820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c8189-143c-4a47-8a6a-068de9f6e104 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:53.542304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:53.542955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.543240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.543520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.556691 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:53.558359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:53.570353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1150/2278] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:54.112476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:54.122102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.122637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:54.138669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5f0a-7179-4580-adef-aad4872949b7 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.144583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.145412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.146089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.158088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] PATH_INFO: `/v3/projects/65f16859b98f4cae9dce0d662d87e657` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.160179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f16859b98f4cae9dce0d662d87e657)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:54.162175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:54.208802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:54.293762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f16859b98f4cae9dce0d662d87e657', 'request_id': 'req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.317395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f16859b98f4cae9dce0d662d87e657', 'request_id': 'req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.343636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f16859b98f4cae9dce0d662d87e657', 'request_id': 'req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.444832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] The token cache is being invalidate because project 65f16859b98f4cae9dce0d662d87e657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:54.447591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.447591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.448496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1129/2279] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:54 2022] DELETE /identity/v3/projects/65f16859b98f4cae9dce0d662d87e657 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:54.453110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.467619 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52473ecb-bde9-44e1-a9a1-360b453b02b5 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.507055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.508586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:54.575303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.576223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.576578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.577025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] PATH_INFO: `/v3/users/5bd442e7dc0b4228b28b6d30ab897a01` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.578266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd442e7dc0b4228b28b6d30ab897a01)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:54.581100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:54.621047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b2a8-3668-4c8e-80b9-b7c6a17d0b79 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.627243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.627899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.628178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.628457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] PATH_INFO: `/v3/users/e7993fa146e342b689f462ac0eaac213` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.629775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7993fa146e342b689f462ac0eaac213)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:54.631834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:54.781521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd442e7dc0b4228b28b6d30ab897a01'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.782193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd442e7dc0b4228b28b6d30ab897a01'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.790966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd442e7dc0b4228b28b6d30ab897a01'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.884566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd442e7dc0b4228b28b6d30ab897a01'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.884786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7993fa146e342b689f462ac0eaac213'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.890932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7993fa146e342b689f462ac0eaac213'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.891714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7993fa146e342b689f462ac0eaac213'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.892390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7993fa146e342b689f462ac0eaac213'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.901749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-37363c28-2e95-44bb-aa6b-f4f172f8c6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd442e7dc0b4228b28b6d30ab897a01'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:54.909760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1151/2280] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:54 2022] DELETE /identity/v3/users/5bd442e7dc0b4228b28b6d30ab897a01 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:55.024139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7993fa146e342b689f462ac0eaac213'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:55.065338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1130/2281] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:54 2022] DELETE /identity/v3/users/e7993fa146e342b689f462ac0eaac213 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:55.071170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.071778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.072064 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.109611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:55.109611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:55.242067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1152/2282] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:55.284299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.286237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:55.393621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a77b9-aada-49fa-a33a-d39fb376c548 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.399917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.400696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.401006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.401279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.414911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.416478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.428096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1131/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:55.764716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.797648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.802917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:55.845567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fe1fd-91c3-431a-be42-09f184cfc3e7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.856308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.857871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.858904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.860103 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] PATH_INFO: `/v3/projects/9778dbae4d8d4f15b93db4363b5865f3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.879988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9778dbae4d8d4f15b93db4363b5865f3)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.914625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.058997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9778dbae4d8d4f15b93db4363b5865f3', 'request_id': 'req-07514852-eee1-453d-8af4-0d1cc76f2669'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.148843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.150864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.162326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9778dbae4d8d4f15b93db4363b5865f3', 'request_id': 'req-07514852-eee1-453d-8af4-0d1cc76f2669'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.169722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6eaf-dac3-4c36-bc10-b3d81efecfe5 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.173233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9778dbae4d8d4f15b93db4363b5865f3', 'request_id': 'req-07514852-eee1-453d-8af4-0d1cc76f2669'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.189751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] The token cache is being invalidate because project 9778dbae4d8d4f15b93db4363b5865f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:56.190061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.194725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07514852-eee1-453d-8af4-0d1cc76f2669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.197491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1153/2284] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:55 2022] DELETE /identity/v3/projects/9778dbae4d8d4f15b93db4363b5865f3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:56.218799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bccaf0-8044-45d3-a40f-7b46b7e54bfe None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.219164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bccaf0-8044-45d3-a40f-7b46b7e54bfe None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.219421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bccaf0-8044-45d3-a40f-7b46b7e54bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.249807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-14bccaf0-8044-45d3-a40f-7b46b7e54bfe None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:56.250798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-14bccaf0-8044-45d3-a40f-7b46b7e54bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.270656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.271479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.271919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.272920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] PATH_INFO: `/v3/projects/e9b66f6119f54fbba8bc49a404eea18d` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.275612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b66f6119f54fbba8bc49a404eea18d)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.292575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.338737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1154/2285] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:56.349063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.349063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.349063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.373416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:56.379622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.383277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1155/2286] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:15:56.385170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.386032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.398865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3f07-c330-44ee-9a86-ccc022f7d0f7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.408246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.408246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.408246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.408246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] PATH_INFO: `/v3/users/316fd8875e1e44288d0d44494839439b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.408719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316fd8875e1e44288d0d44494839439b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.410077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.453365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b66f6119f54fbba8bc49a404eea18d', 'request_id': 'req-57a5d351-384e-4be1-be22-5b21bbd90e3b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.454760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.461551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b66f6119f54fbba8bc49a404eea18d', 'request_id': 'req-57a5d351-384e-4be1-be22-5b21bbd90e3b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.469861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b66f6119f54fbba8bc49a404eea18d', 'request_id': 'req-57a5d351-384e-4be1-be22-5b21bbd90e3b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.606656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] The token cache is being invalidate because project e9b66f6119f54fbba8bc49a404eea18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:56.607052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.607711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.612891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1132/2287] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:56 2022] DELETE /identity/v3/projects/e9b66f6119f54fbba8bc49a404eea18d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:56.614183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.616477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.634600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316fd8875e1e44288d0d44494839439b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.635705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316fd8875e1e44288d0d44494839439b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.657228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316fd8875e1e44288d0d44494839439b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.702243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5d351-384e-4be1-be22-5b21bbd90e3b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.708800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.710381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.711088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.711362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.712031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:56.712336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.714036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.730728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1133/2288] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:56.730728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.730728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.739292 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316fd8875e1e44288d0d44494839439b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.748437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49679e-72c4-4d46-af70-4b3b20256094 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.753734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.754605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.754966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.755310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] PATH_INFO: `/v3/users/8988bff819c04c3c93df2a0e8595732a` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.756976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8988bff819c04c3c93df2a0e8595732a)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.759009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.759221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316fd8875e1e44288d0d44494839439b'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:56.766411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1156/2289] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:56 2022] DELETE /identity/v3/users/316fd8875e1e44288d0d44494839439b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:56.772190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.772812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.878184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f5179-1ac8-439f-8112-2f0e0943af20 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.888031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2babfa1-d6d8-44c5-b0eb-0b05a0fb7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.889102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2babfa1-d6d8-44c5-b0eb-0b05a0fb7f5f admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.889591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2babfa1-d6d8-44c5-b0eb-0b05a0fb7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.890223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2babfa1-d6d8-44c5-b0eb-0b05a0fb7f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.893023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2babfa1-d6d8-44c5-b0eb-0b05a0fb7f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.897375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2babfa1-d6d8-44c5-b0eb-0b05a0fb7f5f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.006514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8988bff819c04c3c93df2a0e8595732a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:57.037178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1157/2290] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:56 2022] POST /identity/v3/projects => generated 371 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:57.037178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.037178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.037178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.041856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8988bff819c04c3c93df2a0e8595732a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:57.045853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8988bff819c04c3c93df2a0e8595732a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:57.046999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8988bff819c04c3c93df2a0e8595732a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:57.101783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:57.103950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:57.144371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8988bff819c04c3c93df2a0e8595732a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:57.184376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1134/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:56 2022] DELETE /identity/v3/users/8988bff819c04c3c93df2a0e8595732a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:57.187382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.191262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:57.217913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1158/2292] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:57.249057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.251648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:57.398648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2084-cb41-4ff2-a18b-faa30479fcd8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.400170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29fc4f-94ee-478a-854e-bcc4e4356dae None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.418055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.420118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.421898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.422408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.424395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.431852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.494518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.495533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.496389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.496879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.514915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.516528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.541800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1159/2293] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:15:57.593818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1135/2294] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:57 2022] POST /identity/v3/users => generated 286 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:57.597836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.626804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a46b0f-0c30-4872-a091-7ed126f05d56 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.660461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.661287 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.667272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.667272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.667272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.667272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.680748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1160/2295] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:57.684800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.710315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5486e-7199-49fb-a2a4-fd6eda11ea61 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.715882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8000f4-0021-4887-9eee-e1d13cf1249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.716542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8000f4-0021-4887-9eee-e1d13cf1249d admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.717037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8000f4-0021-4887-9eee-e1d13cf1249d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.717827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8000f4-0021-4887-9eee-e1d13cf1249d admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.718821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8000f4-0021-4887-9eee-e1d13cf1249d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.720824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8000f4-0021-4887-9eee-e1d13cf1249d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.736380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1136/2296] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:57.739980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.753263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaea8a-751b-4cbd-bdcb-03898231a59b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.760897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.764766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.764766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.764766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] PATH_INFO: `/v3/projects/a8f23004c8a947baa654c39597c074a2/users/f7f20b689921424095682358c684f875/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.781264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f23004c8a947baa654c39597c074a2, user_id=f7f20b689921424095682358c684f875, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.783961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.870152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1161/2297] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:57 2022] PUT /identity/v3/projects/a8f23004c8a947baa654c39597c074a2/users/f7f20b689921424095682358c684f875/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:57.871901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.877321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.877781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.909095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:57.910710 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.059816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1137/2298] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:58.069854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.154964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863fff-11d1-4a28-8af2-c564f65e73f9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.160984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.161275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.161505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.161751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.175164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.176623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.179304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.184616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.202954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1162/2299] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:15:58.212302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40cd7a-1db0-45d2-98b3-6abd61c95dce None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.233703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.234361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.234645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.234934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] PATH_INFO: `/v3/projects/4b4254ed01654f03978b540db1904b45` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.239062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4254ed01654f03978b540db1904b45)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.243020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.260044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.302764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.304565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.324510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6606a2-c309-4164-9665-02654afcf3b1 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.331750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.332417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.332758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.333094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] PATH_INFO: `/v3/projects/1c115f63ee4341daa800ff6cf6004c77` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.334908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c115f63ee4341daa800ff6cf6004c77)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.337054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.415426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4254ed01654f03978b540db1904b45', 'request_id': 'req-affef138-c7a3-4801-99f8-4848ab6a6fa3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.424521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4254ed01654f03978b540db1904b45', 'request_id': 'req-affef138-c7a3-4801-99f8-4848ab6a6fa3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.432232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4254ed01654f03978b540db1904b45', 'request_id': 'req-affef138-c7a3-4801-99f8-4848ab6a6fa3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.499815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c115f63ee4341daa800ff6cf6004c77', 'request_id': 'req-8108699d-c2c1-496f-bf80-9d934fb82b5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.565726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] The token cache is being invalidate because project 4b4254ed01654f03978b540db1904b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:58.566020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.566657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-affef138-c7a3-4801-99f8-4848ab6a6fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.568386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1138/2300] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:58 2022] DELETE /identity/v3/projects/4b4254ed01654f03978b540db1904b45 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:58.569694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.570105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.570387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.601074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] MFA Rules not processed for user `09fad5976c834572bbf835c9193132b6`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:58.602443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.635180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c115f63ee4341daa800ff6cf6004c77', 'request_id': 'req-8108699d-c2c1-496f-bf80-9d934fb82b5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.648046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c115f63ee4341daa800ff6cf6004c77', 'request_id': 'req-8108699d-c2c1-496f-bf80-9d934fb82b5f'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.668747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] The token cache is being invalidate because project 1c115f63ee4341daa800ff6cf6004c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:15:58.669097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.678584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8108699d-c2c1-496f-bf80-9d934fb82b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:58.678584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1163/2301] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:15:58 2022] DELETE /identity/v3/projects/1c115f63ee4341daa800ff6cf6004c77 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:58.678584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.678584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.678584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.704389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1139/2302] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:58.705434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:58.705680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.706677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.710066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.781582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1164/2303] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:58.787106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7b2b5-ac46-4c21-924a-94a75880f9b1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.790248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.792046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:58.796533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.797519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.798573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.799080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] PATH_INFO: `/v3/users/6c627fc69d0643529096a132acfa227d` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.801460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c627fc69d0643529096a132acfa227d)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.804111 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.805719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff31c-4d27-41db-88c4-7810aaf82505 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.811810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c988f-24fa-402b-bde2-9f0e92764478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.811810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c988f-24fa-402b-bde2-9f0e92764478 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.812094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c988f-24fa-402b-bde2-9f0e92764478 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.812312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c988f-24fa-402b-bde2-9f0e92764478 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.813226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c988f-24fa-402b-bde2-9f0e92764478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.815499 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c988f-24fa-402b-bde2-9f0e92764478 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.896653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.912228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1165/2304] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:58 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:58.914031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.914418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.915047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.939633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:58.942350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:59.016687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c627fc69d0643529096a132acfa227d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:59.027351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c627fc69d0643529096a132acfa227d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:59.030446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c627fc69d0643529096a132acfa227d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:59.032230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c627fc69d0643529096a132acfa227d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:59.068907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1166/2305] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:15:59.072559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.072559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:59.087361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5024cee-360c-4897-9d31-c2d2defc09c2 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.098228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.098228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.098228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.098228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.098726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.098726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.121665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c627fc69d0643529096a132acfa227d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:15:59.144910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1140/2306] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:15:58 2022] DELETE /identity/v3/users/6c627fc69d0643529096a132acfa227d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:59.150082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.202355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1167/2307] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:59 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:59.211019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.233227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d4f7e-ae73-426a-ba96-f6ed7f9192f3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.241085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.241822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.242452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd84d4-a2eb-44f1-89f7-76c4f91d153c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.243675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.244116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.247038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:59.247415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.249243 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.251034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.251668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.251954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.252235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.253441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.255156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.275914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1168/2308] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:59.279946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.283681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1141/2309] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:59.284588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.295468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed16061-ac6f-46d8-8c66-77d3f97b8c2a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.296486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1292-94ab-4d12-8375-2678a6d2dc82 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.300901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.301598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.301885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.302024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.302223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] PATH_INFO: `/v3/projects/e8f64a2c4335487bbd686f5a6dbf0748/users/9ec9888e20bf440c9b7eace7d916a9b7/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.302796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.303486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.303842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.304537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.306746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.327871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f64a2c4335487bbd686f5a6dbf0748, user_id=9ec9888e20bf440c9b7eace7d916a9b7, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.330914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.442212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1169/2310] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:59 2022] PUT /identity/v3/projects/e8f64a2c4335487bbd686f5a6dbf0748/users/9ec9888e20bf440c9b7eace7d916a9b7/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:59.449646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1142/2311] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:15:59 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:59.450145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.451141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.546281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17f44b-9392-4e33-b4c7-14b165719d50 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.553513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.554793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.555190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.555425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.556479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.560014 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.590605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee523c-17ca-4746-adfb-4d0e690beab8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.596485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.597135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.597855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.597855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.598341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.600186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.620170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1170/2312] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:59.628335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.641839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b0f8-ccd6-43fa-b6b8-0607874d450c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.644982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1143/2313] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:15:59 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:59.647392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.651455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.652659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.653661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.654209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] PATH_INFO: `/v3/projects/e8f64a2c4335487bbd686f5a6dbf0748/users/9ec9888e20bf440c9b7eace7d916a9b7/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.657945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f64a2c4335487bbd686f5a6dbf0748, user_id=9ec9888e20bf440c9b7eace7d916a9b7, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.658936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6c713-8c65-47ec-9558-4ce4d43542be admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.661503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.664668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.665799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.666246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.666680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.667506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.669439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.676970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1171/2314] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:59 2022] PUT /identity/v3/projects/e8f64a2c4335487bbd686f5a6dbf0748/users/9ec9888e20bf440c9b7eace7d916a9b7/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:59.682516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1144/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:15:59.690190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.723967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:59.777708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bdb7-aaff-4b9d-b2ed-0e5693e50ea6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.783753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcaf2f-d4eb-439d-97b5-c6a98a9fffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.785238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcaf2f-d4eb-439d-97b5-c6a98a9fffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.785725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcaf2f-d4eb-439d-97b5-c6a98a9fffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.786290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcaf2f-d4eb-439d-97b5-c6a98a9fffc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.787413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcaf2f-d4eb-439d-97b5-c6a98a9fffc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.789849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dcaf2f-d4eb-439d-97b5-c6a98a9fffc5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.802382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1172/2316] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:15:59.806955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.817958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81c8b-7d7f-4616-9f69-d4482dad75d6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.824478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.825216 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.825552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.825845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] PATH_INFO: `/v3/projects/09af48c9264e4e03be0228108ca56119/users/05a737cfa2db44cfb8dd10fe49e9e9d8/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.860426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09af48c9264e4e03be0228108ca56119, user_id=05a737cfa2db44cfb8dd10fe49e9e9d8, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.863272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.973306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1145/2317] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:15:59 2022] PUT /identity/v3/projects/09af48c9264e4e03be0228108ca56119/users/05a737cfa2db44cfb8dd10fe49e9e9d8/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:59.977567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.978227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.978699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.016110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] MFA Rules not processed for user `05a737cfa2db44cfb8dd10fe49e9e9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:00.017594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.045225 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.047401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.159235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1173/2318] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:00.173865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.175694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.191055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98056c7b-5b65-47e5-861f-f89f7de96043 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.212210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.213456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.213743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.214026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] PATH_INFO: `/v3/projects/e7127b22a5254296b3923522e9e14488` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.215278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7127b22a5254296b3923522e9e14488)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.217569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.271584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b4f7-0dfb-4b4c-9ce9-97b7acf7963f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.277586 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fe46d-b0fc-4efa-8647-927b935366d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.278723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe46d-b0fc-4efa-8647-927b935366d0 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.278723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe46d-b0fc-4efa-8647-927b935366d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.279008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe46d-b0fc-4efa-8647-927b935366d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.291141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fe46d-b0fc-4efa-8647-927b935366d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.293884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fe46d-b0fc-4efa-8647-927b935366d0 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.317506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1174/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:16:00.420067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7127b22a5254296b3923522e9e14488', 'request_id': 'req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:00.431156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7127b22a5254296b3923522e9e14488', 'request_id': 'req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:00.438280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7127b22a5254296b3923522e9e14488', 'request_id': 'req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:00.455648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b58b-8b71-4d71-a688-4e7e6c141560 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.456363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b58b-8b71-4d71-a688-4e7e6c141560 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.456575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b58b-8b71-4d71-a688-4e7e6c141560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.537424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] The token cache is being invalidate because project e7127b22a5254296b3923522e9e14488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:00.538356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:00.539713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53ba4628-dfd9-49bd-ada6-c31a07cf58fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:00.543645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1146/2320] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:00 2022] DELETE /identity/v3/projects/e7127b22a5254296b3923522e9e14488 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:00.550785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.554678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-90e6b58b-8b71-4d71-a688-4e7e6c141560 None None] MFA Rules not processed for user `f7f20b689921424095682358c684f875`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:00.555213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.555665 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.558579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-90e6b58b-8b71-4d71-a688-4e7e6c141560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.604259 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:00.608622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.705664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1147/2321] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:00.714045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1175/2322] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:00.717559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.718124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.718891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.772566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.772728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:00.773620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.774277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.794042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1176/2323] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:00.798176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.808279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0085-de0c-460c-8324-fd9c3fd95d5a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.813645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.814550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.815039 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.815528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.816321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:00.816757 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.818807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.835026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1177/2324] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:00.839806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.851990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249648fc-5d87-47e7-a6d2-f352a2a85050 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.852223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a49ee-cb4b-4c2d-9bfa-0f6e1b7bba1b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.855952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.856951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.857158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.857272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.857512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.857803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.858090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.858373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.859023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.860964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.866885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.868340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.878813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1148/2325] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:01.009094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1178/2326] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:16:00 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:01.016292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.024801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.040181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393f14-6444-4213-b8c5-6f1373ffa42e service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.130489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.141210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.142573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.142573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.145872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.149548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.292618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1149/2327] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:16:01 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:01.296740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.308002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c419-06df-4b14-8c96-76bcba187942 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.321988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.321988 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.322957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.323335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.324187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.326937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.338573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1179/2328] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:16:01.342964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.358660 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74472b-99c2-4f07-94b7-cf4345d28710 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.363567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f3bac-51f1-46b5-8970-3f8637b00b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.364253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3bac-51f1-46b5-8970-3f8637b00b34 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.364611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3bac-51f1-46b5-8970-3f8637b00b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.364981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3bac-51f1-46b5-8970-3f8637b00b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.365799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f3bac-51f1-46b5-8970-3f8637b00b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.370261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f3bac-51f1-46b5-8970-3f8637b00b34 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.392339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1150/2329] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:01.392742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.414973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6887-593c-4716-bb61-12b73e804158 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.430565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.431948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.432376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.432799 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] PATH_INFO: `/v3/projects/fa4865ff37bf434683e098582d159043/users/c969d3b0a8f94d3994e8fc686607a75d/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.452796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4865ff37bf434683e098582d159043, user_id=c969d3b0a8f94d3994e8fc686607a75d, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.455979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.542816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1180/2330] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:16:01 2022] PUT /identity/v3/projects/fa4865ff37bf434683e098582d159043/users/c969d3b0a8f94d3994e8fc686607a75d/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:01.545056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15b16-f32d-47e0-8a86-f920f2aee97c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.545527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15b16-f32d-47e0-8a86-f920f2aee97c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.545649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc15b16-f32d-47e0-8a86-f920f2aee97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.599105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-bdc15b16-f32d-47e0-8a86-f920f2aee97c None None] MFA Rules not processed for user `c969d3b0a8f94d3994e8fc686607a75d`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:01.601549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-bdc15b16-f32d-47e0-8a86-f920f2aee97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:01.727936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1151/2331] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:01.741380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.905369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5646e-4c48-4f9d-97a4-a9458140e6d1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.919442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948c6fe-7e54-414e-abc0-2a2d6dd7ae75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.922143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c6fe-7e54-414e-abc0-2a2d6dd7ae75 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.922143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c6fe-7e54-414e-abc0-2a2d6dd7ae75 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.922143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c6fe-7e54-414e-abc0-2a2d6dd7ae75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.937279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c6fe-7e54-414e-abc0-2a2d6dd7ae75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.942438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c6fe-7e54-414e-abc0-2a2d6dd7ae75 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.964828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1181/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:01.978056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:03.354766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d081-8504-4483-afd4-c884242c9da2 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.355425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d081-8504-4483-afd4-c884242c9da2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.355425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d081-8504-4483-afd4-c884242c9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.382902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d8b0d081-8504-4483-afd4-c884242c9da2 None None] MFA Rules not processed for user `05a737cfa2db44cfb8dd10fe49e9e9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:03.384446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d8b0d081-8504-4483-afd4-c884242c9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:03.467816 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1152/2333] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:03.686802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:03.934346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.935043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.935165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.961978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] MFA Rules not processed for user `f7f20b689921424095682358c684f875`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:03.963582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:04.069605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1182/2334] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:04.768565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:06.597887 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.777507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.779094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f779-56ce-437d-97e2-73ffacf6fc6c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.779521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f779-56ce-437d-97e2-73ffacf6fc6c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.779865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832f779-56ce-437d-97e2-73ffacf6fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.813435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9832f779-56ce-437d-97e2-73ffacf6fc6c None None] MFA Rules not processed for user `9ec9888e20bf440c9b7eace7d916a9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:07.814577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9832f779-56ce-437d-97e2-73ffacf6fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:07.910923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1153/2335] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:07.926204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.934166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.005169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aa47c-8728-477a-863d-f4fa038ba5b9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.009977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.010599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.010886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.011164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.013014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.081802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.083410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.093850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1183/2336] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:08.406262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.406554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.407960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.431689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:08.432924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.536599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1154/2337] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:08.588108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.589557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.715171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ca17-97e4-4894-8eb6-1ac18626570c service glance] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.721678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab660a7-9c8e-409b-b1e5-e9429eeaae08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.722463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab660a7-9c8e-409b-b1e5-e9429eeaae08 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.723141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab660a7-9c8e-409b-b1e5-e9429eeaae08 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.723625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab660a7-9c8e-409b-b1e5-e9429eeaae08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.738743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab660a7-9c8e-409b-b1e5-e9429eeaae08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.741394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab660a7-9c8e-409b-b1e5-e9429eeaae08 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.753263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1184/2338] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:09.608661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.172142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.997613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.770743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.932725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.984533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5eb5-7b0e-4229-9dfb-913b038a74c9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.999558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.000230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.000517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.000796 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] PATH_INFO: `/v3/users/c969d3b0a8f94d3994e8fc686607a75d` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.002267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c969d3b0a8f94d3994e8fc686607a75d)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:13.009466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:13.172215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653977e-0ee1-43ec-9c29-1cfa26c20198 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.172747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653977e-0ee1-43ec-9c29-1cfa26c20198 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.172747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653977e-0ee1-43ec-9c29-1cfa26c20198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.222094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8653977e-0ee1-43ec-9c29-1cfa26c20198 None None] MFA Rules not processed for user `e785778ee1764ea9ade06b8c7515d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:13.226220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8653977e-0ee1-43ec-9c29-1cfa26c20198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:13.287400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c969d3b0a8f94d3994e8fc686607a75d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:13.313020 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c969d3b0a8f94d3994e8fc686607a75d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:13.313881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c969d3b0a8f94d3994e8fc686607a75d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:13.314517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c969d3b0a8f94d3994e8fc686607a75d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:13.339332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1185/2339] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:13.417220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c969d3b0a8f94d3994e8fc686607a75d'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:13.443729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:13.483722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1155/2340] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:12 2022] DELETE /identity/v3/users/c969d3b0a8f94d3994e8fc686607a75d => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:13.488604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.494945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.494945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.557649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:13.559927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:13.733215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1186/2341] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:13.747509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:13.751813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:13.874372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25f99b-a599-459e-a348-c0057fcfbea9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:13.884719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.885744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.886376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.886664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.911496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:13.914504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:13.927918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1156/2342] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:14.135723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.349047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:15.181451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:15.184319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:15.232845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b742-cec4-40fc-b0af-2a150e9b567c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.250113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.252322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.253355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.254258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] PATH_INFO: `/v3/projects/fa4865ff37bf434683e098582d159043` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.256898 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4865ff37bf434683e098582d159043)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:15.264117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:15.533511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4865ff37bf434683e098582d159043', 'request_id': 'req-4747de38-da74-4b52-9a48-986cacf16802'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:15.630674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4865ff37bf434683e098582d159043', 'request_id': 'req-4747de38-da74-4b52-9a48-986cacf16802'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:15.643274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4865ff37bf434683e098582d159043', 'request_id': 'req-4747de38-da74-4b52-9a48-986cacf16802'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:15.673214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] The token cache is being invalidate because project fa4865ff37bf434683e098582d159043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:15.673523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:15.680669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4747de38-da74-4b52-9a48-986cacf16802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:15.682519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1187/2343] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:15 2022] DELETE /identity/v3/projects/fa4865ff37bf434683e098582d159043 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:15.888294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:16.868726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:17.924236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:17.926044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:17.940456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf844f7-1349-457e-9b8f-e1022721a343 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:17.983977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.043647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.044415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.044726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.045101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] PATH_INFO: `/v3/users/f0827052845841b7894bb58bdd5529d3` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.046233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0827052845841b7894bb58bdd5529d3)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:18.048195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:18.822882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0827052845841b7894bb58bdd5529d3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.829798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0827052845841b7894bb58bdd5529d3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.830563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0827052845841b7894bb58bdd5529d3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.831275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0827052845841b7894bb58bdd5529d3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:18.993610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0827052845841b7894bb58bdd5529d3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:19.022212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1157/2344] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:17 2022] DELETE /identity/v3/users/f0827052845841b7894bb58bdd5529d3 => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:19.026854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.027714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.027990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.041210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.052347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:19.054365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:19.130398 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1188/2345] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:19.141827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.143637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:19.230682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7132dc-ab11-4dcd-b021-8d17664d22b4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.234632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eeb0e-6427-4f86-a5da-08eb29ad0239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.235382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eeb0e-6427-4f86-a5da-08eb29ad0239 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.235768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eeb0e-6427-4f86-a5da-08eb29ad0239 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.236160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eeb0e-6427-4f86-a5da-08eb29ad0239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.249719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eeb0e-6427-4f86-a5da-08eb29ad0239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.251250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eeb0e-6427-4f86-a5da-08eb29ad0239 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.265642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1158/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:19.820511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.822094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:19.839731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69f3ac-cb43-4dea-a4d2-01dc0e025114 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.846524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.847538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.848040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.861065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] PATH_INFO: `/v3/projects/d895e1d3461d4c89b1be33b17fbd9b35` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.872982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d895e1d3461d4c89b1be33b17fbd9b35)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.878784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.033491 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd895e1d3461d4c89b1be33b17fbd9b35', 'request_id': 'req-9329a24c-3a30-4901-9687-77cf4171b5d5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.117391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd895e1d3461d4c89b1be33b17fbd9b35', 'request_id': 'req-9329a24c-3a30-4901-9687-77cf4171b5d5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.126459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd895e1d3461d4c89b1be33b17fbd9b35', 'request_id': 'req-9329a24c-3a30-4901-9687-77cf4171b5d5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.137567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] The token cache is being invalidate because project d895e1d3461d4c89b1be33b17fbd9b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:20.137896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.138534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-9329a24c-3a30-4901-9687-77cf4171b5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:20.140036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1189/2347] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:19 2022] DELETE /identity/v3/projects/d895e1d3461d4c89b1be33b17fbd9b35 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:20.341286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.483162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.761468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.103741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.432009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.780553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.868754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.700978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.780610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.915888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.938025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:23.014552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:23.260766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:23.682070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:23.682749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:23.682749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:23.703365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:23.705160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] MFA Rules not processed for user `09fad5976c834572bbf835c9193132b6`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:23.706449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:23.763623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1159/2348] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:23.809078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.477558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.671721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.369158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.563634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.072719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.088774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.157537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.183624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.260553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.384049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.429029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.574707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.591768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.727290 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.183954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.213627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.372276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.435268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.568882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.585985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.671753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.688786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.740180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.808955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.892343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.066117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.215028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.369349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.391882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.524076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.552246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.757625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.797322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.024362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.052321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.195145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.223751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.360951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.406760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.492178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.600883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.726485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.819947 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.940443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.025838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.126248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.177555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.194975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.300902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.597552 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.648776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.714959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.820408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.877490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.906212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:33.388823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4dc6-4f47-4b3b-a3e4-461229130f67 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:33.389449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4dc6-4f47-4b3b-a3e4-461229130f67 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:33.389806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4dc6-4f47-4b3b-a3e4-461229130f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:33.413002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-602b4dc6-4f47-4b3b-a3e4-461229130f67 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:33.413002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-602b4dc6-4f47-4b3b-a3e4-461229130f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:33.491345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1190/2349] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:16:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:33.505690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:33.510394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:33.616253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a84e1-5872-4ad3-9867-dc3e2eeb3f7a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:33.623291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:33.624059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:33.624451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:33.624747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:33.639919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:33.641580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:33.646961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:33.652149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1160/2350] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:34.268221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8f5d-97fd-4257-811d-a484750ea788 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.268515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8f5d-97fd-4257-811d-a484750ea788 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.268797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d8f5d-97fd-4257-811d-a484750ea788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.295693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0c3d8f5d-97fd-4257-811d-a484750ea788 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:34.296866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0c3d8f5d-97fd-4257-811d-a484750ea788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:34.317237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1191/2351] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:34.340794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.368801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f404f0c-8a01-4350-be78-c7d9aa4c4360 service swift] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:34.391850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:34.395541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.395849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.396131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.415046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:34.417490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:34.429655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1161/2352] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:35.600045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fe1f7-14c2-4711-a7cf-82c05fcecf3a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.600549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fe1f7-14c2-4711-a7cf-82c05fcecf3a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.600628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fe1f7-14c2-4711-a7cf-82c05fcecf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.623389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f7fe1f7-14c2-4711-a7cf-82c05fcecf3a None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:35.625176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f7fe1f7-14c2-4711-a7cf-82c05fcecf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:35.636325 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1192/2353] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 30 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:35.662372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.686256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ec670-cd9c-455a-bcec-2275c1f96a95 service swift] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.691363 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.694457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.694754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.695038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.706044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.707771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.718858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1162/2354] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:36.390073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b0e6-7792-46b7-98e1-1d9aba5ed8f1 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:36.390411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b0e6-7792-46b7-98e1-1d9aba5ed8f1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:36.390639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b0e6-7792-46b7-98e1-1d9aba5ed8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:36.411250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f16b0e6-7792-46b7-98e1-1d9aba5ed8f1 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:36.415699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f16b0e6-7792-46b7-98e1-1d9aba5ed8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:36.428149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1193/2355] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:36.445546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:36.459037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743dec1-209b-4e06-b4ee-345b8ed936a0 service swift] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:36.469316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:36.470055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:36.470416 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:36.470696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:36.486508 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:36.500854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:36.509071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1163/2356] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:37.294518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.295018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.295129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.318958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:37.320200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:37.330675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1194/2357] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 30 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:37.352098 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:37.363377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d0d7b-d547-48c1-a5ab-82642e27cf50 service swift] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:37.369087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0382e-a772-4719-9e16-b81905e5c56e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:37.369696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0382e-a772-4719-9e16-b81905e5c56e service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.369976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0382e-a772-4719-9e16-b81905e5c56e service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.370264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0382e-a772-4719-9e16-b81905e5c56e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.378421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0382e-a772-4719-9e16-b81905e5c56e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:37.379995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0382e-a772-4719-9e16-b81905e5c56e service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:37.389664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1164/2358] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:41.030760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.034574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:41.091053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.112984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75929-c81c-4f30-b805-6af6bef1a501 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.120450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.121464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.121973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.122469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] PATH_INFO: `/v3/users/05a737cfa2db44cfb8dd10fe49e9e9d8` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.123935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a737cfa2db44cfb8dd10fe49e9e9d8)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.126958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.380778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a737cfa2db44cfb8dd10fe49e9e9d8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:41.381866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a737cfa2db44cfb8dd10fe49e9e9d8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:41.389735 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a737cfa2db44cfb8dd10fe49e9e9d8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:41.475465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a737cfa2db44cfb8dd10fe49e9e9d8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:41.491284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a737cfa2db44cfb8dd10fe49e9e9d8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:41.498694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1195/2359] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:41 2022] DELETE /identity/v3/users/05a737cfa2db44cfb8dd10fe49e9e9d8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:41.503611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.504150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.504247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.552875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:41.554316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:41.628300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1165/2360] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:41.639448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.641334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:41.727650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee678-1e80-49d5-a826-97dc67748d4d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.731600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739213e-dac7-4780-b964-eb2dfab3d6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.732305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739213e-dac7-4780-b964-eb2dfab3d6ef service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.732668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739213e-dac7-4780-b964-eb2dfab3d6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.733102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739213e-dac7-4780-b964-eb2dfab3d6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.747332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739213e-dac7-4780-b964-eb2dfab3d6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.747332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739213e-dac7-4780-b964-eb2dfab3d6ef service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.756529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1196/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:16:42.013959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.015396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:42.037613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cdcab-540d-4ba3-89c2-013884a5ed50 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.043472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.044419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.044613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.044895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] PATH_INFO: `/v3/projects/09af48c9264e4e03be0228108ca56119` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.046307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09af48c9264e4e03be0228108ca56119)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.048481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.153599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09af48c9264e4e03be0228108ca56119', 'request_id': 'req-d1702fb1-7741-478d-94ff-f8bccded2386'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:42.159869 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09af48c9264e4e03be0228108ca56119', 'request_id': 'req-d1702fb1-7741-478d-94ff-f8bccded2386'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:42.165868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09af48c9264e4e03be0228108ca56119', 'request_id': 'req-d1702fb1-7741-478d-94ff-f8bccded2386'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:42.248450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] The token cache is being invalidate because project 09af48c9264e4e03be0228108ca56119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:42.248744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:42.249404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d1702fb1-7741-478d-94ff-f8bccded2386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:42.250913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1166/2362] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:42 2022] DELETE /identity/v3/projects/09af48c9264e4e03be0228108ca56119 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:42.255922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.256453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.256555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.279217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:42.280438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:42.344497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1197/2363] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:42.352060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.352422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.352702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.379177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:42.380446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:42.393482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1167/2364] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:42.400810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.410847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426eeab-6fde-4cc6-8f3f-6e5a5405ce1f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.415848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.416456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.416745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.417137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.417791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:42.418101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.419706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.421235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.433262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1198/2365] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:42.449095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.459028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6ab1-b0f2-4993-9734-286a43acb6ae None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.465487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.466219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.466650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.467009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.467727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.470004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.584659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1168/2366] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:16:42 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:42.586426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.597190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d71d-2aad-4ffb-9139-29ca61fb1b17 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.672874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.672874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.672874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.672874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.673432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.673432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.767300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1199/2367] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:16:42 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:42.771824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.784123 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.790364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d31739-891e-4984-abaf-6a63807f59e2 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.796666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.797825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.798410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.798928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.799930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.801973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.818835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1169/2368] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:42.819825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.840344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaaee3-37b8-4908-937a-4aaeb5381693 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.848182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238495-32a9-41e5-b63a-ae1afe56c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.852023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238495-32a9-41e5-b63a-ae1afe56c05c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.852023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238495-32a9-41e5-b63a-ae1afe56c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.852023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238495-32a9-41e5-b63a-ae1afe56c05c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.852023 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238495-32a9-41e5-b63a-ae1afe56c05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.853876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238495-32a9-41e5-b63a-ae1afe56c05c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.868730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1200/2369] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:16:42.872849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.884904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c584894-ca8a-49ea-9ee0-f9727b171370 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.890731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.892007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.892528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.893054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] PATH_INFO: `/v3/projects/2aafee3df5fa48c388a6da6c403b11c2/users/29b1d857b1dd4c998b8898d125c3e9db/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.921400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aafee3df5fa48c388a6da6c403b11c2, user_id=29b1d857b1dd4c998b8898d125c3e9db, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.926367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.001493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1170/2370] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:16:42 2022] PUT /identity/v3/projects/2aafee3df5fa48c388a6da6c403b11c2/users/29b1d857b1dd4c998b8898d125c3e9db/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:43.013347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.013634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.013911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.043044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] MFA Rules not processed for user `29b1d857b1dd4c998b8898d125c3e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:43.047397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:43.124652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1201/2371] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:16:43.137005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:43.138669 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:43.201041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f2d6f-8eb7-414a-ad8d-02d11be26752 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:43.204839 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984db5c-828e-401d-af75-758211cdbbb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:43.205555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984db5c-828e-401d-af75-758211cdbbb6 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.206021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984db5c-828e-401d-af75-758211cdbbb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.206300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984db5c-828e-401d-af75-758211cdbbb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.215567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984db5c-828e-401d-af75-758211cdbbb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:43.217134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984db5c-828e-401d-af75-758211cdbbb6 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.226692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1171/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:53.121485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.229645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.938579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.017127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac02d5e-3440-454f-b593-4a11e4e89f68 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.021344 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.022173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.022478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.022789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] PATH_INFO: `/v3/users/29b1d857b1dd4c998b8898d125c3e9db` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.023943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b1d857b1dd4c998b8898d125c3e9db)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.026508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.295707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b1d857b1dd4c998b8898d125c3e9db'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.302296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b1d857b1dd4c998b8898d125c3e9db'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.322465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b1d857b1dd4c998b8898d125c3e9db'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.342439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.348645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.348645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.370244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] MFA Rules not processed for user `f7f20b689921424095682358c684f875`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:55.371505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:55.421009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b1d857b1dd4c998b8898d125c3e9db'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.439805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-56b0ec27-de6a-425a-b14c-e912f993cebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b1d857b1dd4c998b8898d125c3e9db'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:55.457236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1202/2373] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:16:54 2022] DELETE /identity/v3/users/29b1d857b1dd4c998b8898d125c3e9db => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:55.458997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.459440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.459924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.470128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1172/2374] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:55.491653 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:55.493439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:55.561489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1203/2375] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:16:55.572181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.573653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:55.644397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90ebea-043e-44d8-b9c5-26bca6d92be6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.711357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f80df-2491-4c27-be35-81acae22a4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.713318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f80df-2491-4c27-be35-81acae22a4ac service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.713614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f80df-2491-4c27-be35-81acae22a4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.713897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f80df-2491-4c27-be35-81acae22a4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.724909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f80df-2491-4c27-be35-81acae22a4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.726765 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f80df-2491-4c27-be35-81acae22a4ac service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.741321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1173/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:16:56.337689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.339397 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:56.353394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7ebb-2abb-4c6e-b87a-bdda24c55361 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.359268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.360141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.360444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.360755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] PATH_INFO: `/v3/projects/2aafee3df5fa48c388a6da6c403b11c2` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.361946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aafee3df5fa48c388a6da6c403b11c2)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.363888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.381805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.528454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aafee3df5fa48c388a6da6c403b11c2', 'request_id': 'req-987239c0-30a5-433b-bc76-6cbf65325b91'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:56.604663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aafee3df5fa48c388a6da6c403b11c2', 'request_id': 'req-987239c0-30a5-433b-bc76-6cbf65325b91'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:56.612361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aafee3df5fa48c388a6da6c403b11c2', 'request_id': 'req-987239c0-30a5-433b-bc76-6cbf65325b91'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:56.625387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] The token cache is being invalidate because project 2aafee3df5fa48c388a6da6c403b11c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:16:56.625639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:56.626189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:16:56.627955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1204/2377] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:16:56 2022] DELETE /identity/v3/projects/2aafee3df5fa48c388a6da6c403b11c2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:02.380360 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.380880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.381066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.405315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] MFA Rules not processed for user `e5014c331aa04771ac313ffbd2ea19b9`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:02.406691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:02.474161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1174/2378] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:06.621859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.100008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.101907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:07.180606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987239c0-30a5-433b-bc76-6cbf65325b91 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.186068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.186697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.186983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.187320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.189227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:07.202917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.204593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32736b-89db-4a2b-9904-a444af80b63e service placement] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.215660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1205/2379] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:12.291436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.293325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:12.306929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.360846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a7840-66c7-4f92-a653-bd1aff84c58b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.370884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.376051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.376051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.376051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.376051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:12.464520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.466009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.477369 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1175/2380] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:17.210583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=32 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.342268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa9333-f321-4df3-95de-2eefc13ed115 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.342268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa9333-f321-4df3-95de-2eefc13ed115 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.342268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa9333-f321-4df3-95de-2eefc13ed115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.377712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-34fa9333-f321-4df3-95de-2eefc13ed115 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:20.379742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-34fa9333-f321-4df3-95de-2eefc13ed115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:20.459369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1206/2381] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:17:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:17:20.490028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.491570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:20.571974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd4006-813c-4496-bf65-f1580dd10086 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.578588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.579265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.579551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.579825 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.589267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.590863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.599404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1176/2382] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:25.663130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f2df-203e-490f-a5e1-066faae7b5ea None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.664227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f2df-203e-490f-a5e1-066faae7b5ea None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.664415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f2df-203e-490f-a5e1-066faae7b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.696057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-00b4f2df-203e-490f-a5e1-066faae7b5ea None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:25.697664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-00b4f2df-203e-490f-a5e1-066faae7b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:25.711545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1207/2383] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:17:25.722703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.737937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaa0ef-8c22-4908-a7c9-dd0821167e53 service swift] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.745451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f2079-4cb9-464c-ac8f-0ab55a66582b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.746050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2079-4cb9-464c-ac8f-0ab55a66582b service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.746525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2079-4cb9-464c-ac8f-0ab55a66582b service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.746993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2079-4cb9-464c-ac8f-0ab55a66582b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.759459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f2079-4cb9-464c-ac8f-0ab55a66582b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.762884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f2079-4cb9-464c-ac8f-0ab55a66582b service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.785143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1177/2384] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:17:35.689261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=28 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:35.770417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=84 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:40.218519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb853d9-ee91-4ad2-8912-c65dddf9b1ff None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.219467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb853d9-ee91-4ad2-8912-c65dddf9b1ff None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.219812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb853d9-ee91-4ad2-8912-c65dddf9b1ff None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.221804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1208/2385] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:40.232240 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9f3f-614f-4774-a972-93d02f2a85d1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.232817 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9f3f-614f-4774-a972-93d02f2a85d1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.233436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9f3f-614f-4774-a972-93d02f2a85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.260249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-19db9f3f-614f-4774-a972-93d02f2a85d1 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:40.262278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-19db9f3f-614f-4774-a972-93d02f2a85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:40.351962 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1178/2386] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:40.364055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb853d9-ee91-4ad2-8912-c65dddf9b1ff None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:40.366912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-edb853d9-ee91-4ad2-8912-c65dddf9b1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:40.438604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb853d9-ee91-4ad2-8912-c65dddf9b1ff None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:40.442578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780ec26-bde0-43a3-85a0-9d748bad29b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:40.443416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780ec26-bde0-43a3-85a0-9d748bad29b7 service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.443839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780ec26-bde0-43a3-85a0-9d748bad29b7 service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.444028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780ec26-bde0-43a3-85a0-9d748bad29b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.457101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780ec26-bde0-43a3-85a0-9d748bad29b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:40.458565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780ec26-bde0-43a3-85a0-9d748bad29b7 service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:40.475449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1209/2387] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:40.714939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c6e91-ca55-4376-88d6-48aa60476a5a None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.715233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c6e91-ca55-4376-88d6-48aa60476a5a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.715525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c6e91-ca55-4376-88d6-48aa60476a5a None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.717114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1179/2388] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:40.725726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c75d9-f39c-4bf5-885e-1786f01d4fde None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.725726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c75d9-f39c-4bf5-885e-1786f01d4fde None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.725726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c75d9-f39c-4bf5-885e-1786f01d4fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.749538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-891c75d9-f39c-4bf5-885e-1786f01d4fde None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:40.750787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-891c75d9-f39c-4bf5-885e-1786f01d4fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:40.758317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1210/2389] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:40.771504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c6e91-ca55-4376-88d6-48aa60476a5a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:40.783674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c6e91-ca55-4376-88d6-48aa60476a5a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:40.787496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c95cf-91f7-408e-bb31-fdd99022003a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:40.788176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c95cf-91f7-408e-bb31-fdd99022003a service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.788519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c95cf-91f7-408e-bb31-fdd99022003a service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.788705 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c95cf-91f7-408e-bb31-fdd99022003a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.798626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c95cf-91f7-408e-bb31-fdd99022003a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:40.800466 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c95cf-91f7-408e-bb31-fdd99022003a service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:40.809903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1180/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:40.901728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478f5a6-092e-40dd-880b-10543423fbe8 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.902177 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478f5a6-092e-40dd-880b-10543423fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.902678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478f5a6-092e-40dd-880b-10543423fbe8 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.904141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1211/2391] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:40.910139 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21f6f-85cd-4e28-8c08-97de0f729e53 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.910537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21f6f-85cd-4e28-8c08-97de0f729e53 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.910883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21f6f-85cd-4e28-8c08-97de0f729e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.932046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a2b21f6f-85cd-4e28-8c08-97de0f729e53 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:40.933186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a2b21f6f-85cd-4e28-8c08-97de0f729e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:40.943534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1181/2392] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:40.955682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478f5a6-092e-40dd-880b-10543423fbe8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:40.968688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478f5a6-092e-40dd-880b-10543423fbe8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:40.972702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:40.973373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.973694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.973982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.993865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:40.995925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.009221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1212/2393] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:43.912043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef06c8-1fac-4c0a-91a0-b51c9a6f3782 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:43.913107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef06c8-1fac-4c0a-91a0-b51c9a6f3782 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:43.913107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef06c8-1fac-4c0a-91a0-b51c9a6f3782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:43.934087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-a9ef06c8-1fac-4c0a-91a0-b51c9a6f3782 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:43.935396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a9ef06c8-1fac-4c0a-91a0-b51c9a6f3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:43.943976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1182/2394] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 30 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:43.958990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:43.973888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a04fb-e281-46d0-b37d-cf0375ff7632 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:43.980364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:43.981170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:43.981526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:43.981877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:43.991158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:43.992853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:44.003096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1213/2395] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:17:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:45.083450 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.083930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.084031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.105178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:45.106490 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:45.114400 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1183/2396] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:45.127041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.138341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faa046-49f2-4516-81ec-cadecedc78b6 service swift] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.143633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.144615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.144615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.144875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.153699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.155358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.163936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1214/2397] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:47.067721 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:47.070193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:47.163079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac89df-d51a-463e-95c1-82bea20c07e2 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:47.171260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:47.171920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.172206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.172489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] PATH_INFO: `/v3/users/f7f20b689921424095682358c684f875` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.173714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f20b689921424095682358c684f875)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:47.175857 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:47.323829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f20b689921424095682358c684f875'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:47.333760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f20b689921424095682358c684f875'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:47.334618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f20b689921424095682358c684f875'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:47.335314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f20b689921424095682358c684f875'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:47.341175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:47.411028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b25de48c-8a55-4bdf-b997-848db9be5cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f20b689921424095682358c684f875'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:47.434809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1184/2398] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:17:47 2022] DELETE /identity/v3/users/f7f20b689921424095682358c684f875 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:47.750113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:47.761652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361dc25-adba-4e22-b43b-3e2c7330d1a1 service swift] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:47.835878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800de728-470a-4e38-888c-3638d390999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:47.836551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de728-470a-4e38-888c-3638d390999d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.837046 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de728-470a-4e38-888c-3638d390999d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.837324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de728-470a-4e38-888c-3638d390999d admin admin] PATH_INFO: `/v3/projects/a8f23004c8a947baa654c39597c074a2` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.839249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800de728-470a-4e38-888c-3638d390999d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f23004c8a947baa654c39597c074a2)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:47.841340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800de728-470a-4e38-888c-3638d390999d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:47.956654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-800de728-470a-4e38-888c-3638d390999d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f23004c8a947baa654c39597c074a2', 'request_id': 'req-800de728-470a-4e38-888c-3638d390999d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:48.006803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-800de728-470a-4e38-888c-3638d390999d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f23004c8a947baa654c39597c074a2', 'request_id': 'req-800de728-470a-4e38-888c-3638d390999d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:48.009288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:48.020109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-800de728-470a-4e38-888c-3638d390999d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f23004c8a947baa654c39597c074a2', 'request_id': 'req-800de728-470a-4e38-888c-3638d390999d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:48.036597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-800de728-470a-4e38-888c-3638d390999d admin admin] The token cache is being invalidate because project a8f23004c8a947baa654c39597c074a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:17:48.037019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-800de728-470a-4e38-888c-3638d390999d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:48.037820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-800de728-470a-4e38-888c-3638d390999d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:17:48.039319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1215/2399] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:17:47 2022] DELETE /identity/v3/projects/a8f23004c8a947baa654c39597c074a2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:48.044651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.044950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.045245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.069282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:48.070513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:48.137845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1185/2400] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:48.145298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.145508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.145782 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.167381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:48.168614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:48.176572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1216/2401] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:17:48.181276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.192178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317413-4691-4001-82f3-56e0b697ebf6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.197084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.198069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.198069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.198266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.198909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:48.199219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.200829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.214061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1186/2402] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:48.218349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.233042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6901c9-1026-4204-a760-066be94709e3 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.238305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.239181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.239510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.239868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.240628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.242673 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.342313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1217/2403] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:17:48 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:48.345940 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.357556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62d313-ec03-495d-944a-0a4ce413c7e6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.422752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.423291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.423579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.423861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.424512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.426559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.523811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1187/2404] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:48 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:48.529097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.540345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc31da-1ee6-4b1a-85c1-47a360140cc6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.551788 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.552430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.552719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.553032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.553793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.555369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.569751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1218/2405] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:48.570966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.582205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9009-c9dc-481f-b36e-cad864ca34e2 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.587035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5a988-a197-4f20-b2a6-841fb8f20769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.588190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a988-a197-4f20-b2a6-841fb8f20769 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.588618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a988-a197-4f20-b2a6-841fb8f20769 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.589063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5a988-a197-4f20-b2a6-841fb8f20769 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.589724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5a988-a197-4f20-b2a6-841fb8f20769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.591343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5a988-a197-4f20-b2a6-841fb8f20769 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.603218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1188/2406] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:17:48.608293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.618913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de098b-6170-48b2-8665-2461af8cbfb5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.623798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.624466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.624753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.625072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] PATH_INFO: `/v3/projects/b8be4fa5db564bad8962dcf936e7167b/users/b3abf70dec464ee69bb52e364321573b/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.645944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8be4fa5db564bad8962dcf936e7167b, user_id=b3abf70dec464ee69bb52e364321573b, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.648680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.751447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1219/2407] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:17:48 2022] PUT /identity/v3/projects/b8be4fa5db564bad8962dcf936e7167b/users/b3abf70dec464ee69bb52e364321573b/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:48.754063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cb724-05f7-49d8-85f1-2b096fc8bd90 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.754358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cb724-05f7-49d8-85f1-2b096fc8bd90 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.754646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cb724-05f7-49d8-85f1-2b096fc8bd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.787888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b64cb724-05f7-49d8-85f1-2b096fc8bd90 None None] MFA Rules not processed for user `b3abf70dec464ee69bb52e364321573b`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:48.789278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b64cb724-05f7-49d8-85f1-2b096fc8bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:48.834061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:48.876189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1189/2408] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:17:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:17:48.888761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.890666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:48.959764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d78c99-be6d-4abe-9810-9fb7f406a4a2 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.964496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.965145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.965432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.965707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.974846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.976298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.990409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1220/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:17:58.983081 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:59.029658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=12 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:11.412004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.413550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.413550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.435045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:11.436292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:11.497348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1190/2410] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 30 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:18:11.510959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:11.517006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:11.583529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271f70d-8cdb-4971-b62a-d9fbc4b2ce7b service glance] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:11.589040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314479a-7c37-49a5-8356-1ac588575890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:11.589642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314479a-7c37-49a5-8356-1ac588575890 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.589925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314479a-7c37-49a5-8356-1ac588575890 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.590201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314479a-7c37-49a5-8356-1ac588575890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.598515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314479a-7c37-49a5-8356-1ac588575890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:11.600102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314479a-7c37-49a5-8356-1ac588575890 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:11.610092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1221/2411] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:20.767195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:20.830549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9729e-25ae-465f-a52f-1d07602581d3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:20.835062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:20.835688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:20.835984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:20.836264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] PATH_INFO: `/v3/users/b3abf70dec464ee69bb52e364321573b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:20.837408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3abf70dec464ee69bb52e364321573b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:20.839370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:21.055835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3abf70dec464ee69bb52e364321573b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:21.064299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3abf70dec464ee69bb52e364321573b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:21.065034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3abf70dec464ee69bb52e364321573b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:21.065653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3abf70dec464ee69bb52e364321573b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:21.177065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3abf70dec464ee69bb52e364321573b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:21.195136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1191/2412] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:20 2022] DELETE /identity/v3/users/b3abf70dec464ee69bb52e364321573b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:21.200215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:21.200778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:21.200778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:21.220171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:21.221403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:21.279525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1222/2413] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:21.289408 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:21.290847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:21.321509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:21.357079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d889ee0-3a06-4266-a7d9-969e0a34724a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:21.360824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9577-dcc8-4a19-9690-aef48231491b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:21.361465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9577-dcc8-4a19-9690-aef48231491b service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:21.361744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9577-dcc8-4a19-9690-aef48231491b service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:21.362016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9577-dcc8-4a19-9690-aef48231491b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:21.372149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e9577-dcc8-4a19-9690-aef48231491b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:21.374487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e9577-dcc8-4a19-9690-aef48231491b service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:21.384573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1192/2414] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:21.809557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:21.811100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:21.823982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6c6d-f0b5-4752-8ead-5410dbbe4364 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:21.829282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:21.829980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:21.830385 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:21.830577 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] PATH_INFO: `/v3/projects/b8be4fa5db564bad8962dcf936e7167b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:21.831846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8be4fa5db564bad8962dcf936e7167b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:21.833999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:21.969134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8be4fa5db564bad8962dcf936e7167b', 'request_id': 'req-75200e28-a3bc-44bc-abfc-b2715be05473'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:22.030191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8be4fa5db564bad8962dcf936e7167b', 'request_id': 'req-75200e28-a3bc-44bc-abfc-b2715be05473'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:22.038053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8be4fa5db564bad8962dcf936e7167b', 'request_id': 'req-75200e28-a3bc-44bc-abfc-b2715be05473'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:22.051208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] The token cache is being invalidate because project b8be4fa5db564bad8962dcf936e7167b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:22.051505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:22.052169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-75200e28-a3bc-44bc-abfc-b2715be05473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:22.053855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1223/2415] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:21 2022] DELETE /identity/v3/projects/b8be4fa5db564bad8962dcf936e7167b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:22.059313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.059850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.059850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.080753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:22.082007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.143179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1193/2416] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:18:22.151538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.151832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.152117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.172777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:22.174040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.182311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1224/2417] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:22.187809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.197613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9b650-7dc7-4665-9a44-f090933e8294 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.202332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.203288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.203569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.203846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.204487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:22.204789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.206428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.221476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1194/2418] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:22.225964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.236866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58e5c2-a274-458c-bb82-675f68b6b5e7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.241949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.242615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.242899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.243181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.243822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.246031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.256165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:22.321053 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1225/2419] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:22 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:22.325832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.336209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344eb6c-5ce9-45c1-8725-ac45d2069cdb admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.396330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.396876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.397194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.397476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.398138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.400080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.499045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1195/2420] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:22 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:22.503226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.519908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e8385-4062-458e-89a9-6117d25457fc admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.524244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.524846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.525229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.525699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.526455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.528088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.538380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1226/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:22.543193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.553258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f359b62-95b9-44d4-b6a3-7c4300b61d56 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.558889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890de67-210b-45d1-be2b-ddf7b8382459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.559499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890de67-210b-45d1-be2b-ddf7b8382459 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.559782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890de67-210b-45d1-be2b-ddf7b8382459 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.560060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890de67-210b-45d1-be2b-ddf7b8382459 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.560702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890de67-210b-45d1-be2b-ddf7b8382459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.562349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890de67-210b-45d1-be2b-ddf7b8382459 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.573826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1196/2422] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:22.578203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.588371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117728bf-b543-4afb-93d6-dce4f45ffae0 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.593117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.593769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.594052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.594332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] PATH_INFO: `/v3/projects/1d19f660510248d5990a96c973556198/users/0250fdbb6b09419d81f9830a2aee46a3/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.611447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d19f660510248d5990a96c973556198, user_id=0250fdbb6b09419d81f9830a2aee46a3, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.614181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.700925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1227/2423] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:22 2022] PUT /identity/v3/projects/1d19f660510248d5990a96c973556198/users/0250fdbb6b09419d81f9830a2aee46a3/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:22.765915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.765915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.765915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.765915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] MFA Rules not processed for user `0250fdbb6b09419d81f9830a2aee46a3`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:22.765915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.773065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:22.818586 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1197/2424] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:22.830511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:22.832282 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:22.889774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3ec00-a0b4-49c5-b351-a6b91ddfc814 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:22.893453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bf4b-3940-4747-b08d-1657d3be4929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:22.894059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf4b-3940-4747-b08d-1657d3be4929 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:22.894346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf4b-3940-4747-b08d-1657d3be4929 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:22.894621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bf4b-3940-4747-b08d-1657d3be4929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:22.904593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bf4b-3940-4747-b08d-1657d3be4929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:22.907980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43bf4b-3940-4747-b08d-1657d3be4929 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:22.918132 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1228/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:22.943042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:23.007588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d58512-de60-4c0a-b943-3978f67da418 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:23.012697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:23.013368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.013656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.013936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] PATH_INFO: `/v3/users/0250fdbb6b09419d81f9830a2aee46a3` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.015081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0250fdbb6b09419d81f9830a2aee46a3)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:23.017045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:23.253131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0250fdbb6b09419d81f9830a2aee46a3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:23.260783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0250fdbb6b09419d81f9830a2aee46a3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:23.261536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0250fdbb6b09419d81f9830a2aee46a3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:23.262159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0250fdbb6b09419d81f9830a2aee46a3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:23.326700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0250fdbb6b09419d81f9830a2aee46a3'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:23.345760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1198/2426] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:18:22 2022] DELETE /identity/v3/users/0250fdbb6b09419d81f9830a2aee46a3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:23.350501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.352860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.352860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.372038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:23.375828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:23.433380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1229/2427] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:23.443381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:23.444787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:23.495656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:23.507227 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40ccb4-8640-4473-b623-64cff37c52ea admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:23.524762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e4417-02e9-4aba-a6da-3b3062396caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:23.524762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e4417-02e9-4aba-a6da-3b3062396caa service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.524762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e4417-02e9-4aba-a6da-3b3062396caa service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.524762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e4417-02e9-4aba-a6da-3b3062396caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.526415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e4417-02e9-4aba-a6da-3b3062396caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:23.526415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e4417-02e9-4aba-a6da-3b3062396caa service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:23.536726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1199/2428] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:18:23.975764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:23.977346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.014556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165acd-15f1-403f-9dca-3b6c98b28e4e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.014556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.014556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.014556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.015482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] PATH_INFO: `/v3/projects/1d19f660510248d5990a96c973556198` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.015482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d19f660510248d5990a96c973556198)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.015482 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.133020 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:24.134433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d19f660510248d5990a96c973556198', 'request_id': 'req-003e7ed4-d231-47b9-b4b9-e09132358df7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:24.210845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d19f660510248d5990a96c973556198', 'request_id': 'req-003e7ed4-d231-47b9-b4b9-e09132358df7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:24.218147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d19f660510248d5990a96c973556198', 'request_id': 'req-003e7ed4-d231-47b9-b4b9-e09132358df7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:24.230833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] The token cache is being invalidate because project 1d19f660510248d5990a96c973556198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:18:24.231133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:24.231810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-003e7ed4-d231-47b9-b4b9-e09132358df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:18:24.233389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1230/2429] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:18:23 2022] DELETE /identity/v3/projects/1d19f660510248d5990a96c973556198 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:24.238457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.238755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.239042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.259386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:24.260823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.320110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1200/2430] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:24.328018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.328311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.328591 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.348709 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:24.349955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.358232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1231/2431] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:24.362544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.375058 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cea2b8-8318-48e4-84f1-5672749d2c8c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.379958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.380569 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.380855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.381195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.381815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:24.382119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.383712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.395900 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1201/2432] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:24.400319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.411793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833fa5a-b9ff-484a-b6a5-745c49c7c1cf None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.418253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.418963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.419247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.419524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.420175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.422610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.516749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1232/2433] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:18:24 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:24.519622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.530472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468204-53e4-4aac-b9f7-06a19a9f7018 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.586445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.586965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.587244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.587520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.588703 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.590637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.668504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1202/2434] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:18:24 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:24.672565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.683114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e60627-67f8-477e-b84c-29fd1d3ce933 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.688019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.688626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.688910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.689259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.689908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.691530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.704001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1233/2435] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:24.709715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.720867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc823f-5498-413d-a5bd-f20c132fa687 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.725752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6efba-7b86-4362-9dc3-ea3a7865b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.726357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6efba-7b86-4362-9dc3-ea3a7865b1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.726643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6efba-7b86-4362-9dc3-ea3a7865b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.726921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6efba-7b86-4362-9dc3-ea3a7865b1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.727566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6efba-7b86-4362-9dc3-ea3a7865b1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.729341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6efba-7b86-4362-9dc3-ea3a7865b1b6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.740031 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1203/2436] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:18:24.744458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.754475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f6f1-bd34-4357-a28d-23c23fafb509 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:24.759270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:24.760462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.760741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.761048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] PATH_INFO: `/v3/projects/4dacc6dc53c7454ba914fb668428e6df/users/49c7d1102ab7443c81dd2de4d0d666b4/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.775062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dacc6dc53c7454ba914fb668428e6df, user_id=49c7d1102ab7443c81dd2de4d0d666b4, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:24.778404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:24.863966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1234/2437] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:18:24 2022] PUT /identity/v3/projects/4dacc6dc53c7454ba914fb668428e6df/users/49c7d1102ab7443c81dd2de4d0d666b4/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:24.869065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cdfc2-7174-49b9-bddc-b53f75049251 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:24.869380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cdfc2-7174-49b9-bddc-b53f75049251 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:24.869690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cdfc2-7174-49b9-bddc-b53f75049251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:24.889907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5c7cdfc2-7174-49b9-bddc-b53f75049251 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:24.891160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5c7cdfc2-7174-49b9-bddc-b53f75049251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:24.935671 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:24.950110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1204/2438] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:24.959785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:24.961557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:25.024814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d24b7-0151-4450-8c8b-3b6b53ef2734 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:25.029712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:25.030326 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:25.030617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:25.030902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:25.040057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:25.041733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:25.051134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1235/2439] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:26.308641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e440-c05e-4c85-a882-4a8e1221ff44 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:26.309221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e440-c05e-4c85-a882-4a8e1221ff44 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:26.309221 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e440-c05e-4c85-a882-4a8e1221ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:26.341052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0962e440-c05e-4c85-a882-4a8e1221ff44 None None] MFA Rules not processed for user `49c7d1102ab7443c81dd2de4d0d666b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:26.345845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0962e440-c05e-4c85-a882-4a8e1221ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:26.420686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1205/2440] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:26.431865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:26.433529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:26.494779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330154b4-ebec-4d39-8de3-312ad0dbdf3e service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:26.498226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973285c2-7f7e-459c-bcd9-f9d9f9f82df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:26.498835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973285c2-7f7e-459c-bcd9-f9d9f9f82df7 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:26.499140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973285c2-7f7e-459c-bcd9-f9d9f9f82df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:26.499416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973285c2-7f7e-459c-bcd9-f9d9f9f82df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:26.507932 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973285c2-7f7e-459c-bcd9-f9d9f9f82df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:26.509432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973285c2-7f7e-459c-bcd9-f9d9f9f82df7 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:26.519329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1236/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:18:28.282745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:28.283332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:28.283438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:28.304548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] MFA Rules not processed for user `49c7d1102ab7443c81dd2de4d0d666b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:28.305815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:28.313127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1206/2442] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:18:36.515082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:38.299310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=39 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:06.188796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e76a-5c7b-40d1-98da-b885dc910ab5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:06.189366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e76a-5c7b-40d1-98da-b885dc910ab5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:06.189467 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e76a-5c7b-40d1-98da-b885dc910ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:06.210676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3258e76a-5c7b-40d1-98da-b885dc910ab5 None None] MFA Rules not processed for user `e785778ee1764ea9ade06b8c7515d0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:06.211975 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3258e76a-5c7b-40d1-98da-b885dc910ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:06.270474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1237/2443] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:07.851644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:07.864659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e222-9105-4a96-b0b8-1334e9c9bf72 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:07.869686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:07.870404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:07.870690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:07.870970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:07.873173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:07.962693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:07.965890 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:07.983511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1207/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:10.236125 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:10.236741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:10.236741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:10.257922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:10.259135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:10.267345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1238/2445] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:10.293967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:10.295384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:10.301752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:10.303136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:10.309781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec83b4-5b38-4758-9212-d14b5be89463 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:10.315248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:10.315915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:10.316129 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:10.316412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:10.318795 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c02a4-b7bf-4d1e-bd8b-bd94923a590c None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:10.324737 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:10.324926 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:10.325393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:10.325660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:10.325942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:10.326637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:10.327785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:10.338461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1208/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:10.343583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:10.344644 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10195c58-fe7e-42d8-9b52-cc2f2691000a service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:10.354986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1239/2447] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:19:11.035035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:11.044238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1c76e-ddce-4f8d-aa28-f5b0aebf4f82 service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:11.047893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:11.051738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:11.051738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:11.051738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:11.051738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:11.065396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:11.066823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:11.078327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1209/2448] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:17.755102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:17.755654 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:17.756071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:17.788094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:17.789535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:17.819184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1240/2449] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:17.833051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:17.845959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95e297-5e83-4a05-86d3-9a0955195c2d service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:17.852714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86a357-12a1-4dad-ba5c-cbc0a0439006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:17.853646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a357-12a1-4dad-ba5c-cbc0a0439006 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:17.854119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a357-12a1-4dad-ba5c-cbc0a0439006 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:17.854507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a357-12a1-4dad-ba5c-cbc0a0439006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:17.864292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86a357-12a1-4dad-ba5c-cbc0a0439006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:17.866278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86a357-12a1-4dad-ba5c-cbc0a0439006 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:17.893764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1210/2450] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:21.538432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:21.550135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5605955-3dea-4a47-93bd-abdcdba508eb None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:21.555643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:21.556278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:21.556562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:21.556839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:21.559358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:21.618184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:21.620440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:21.630162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1241/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:22.304632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9a697-8200-4e57-ba1d-dee95f85606d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:22.305209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9a697-8200-4e57-ba1d-dee95f85606d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:22.305335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9a697-8200-4e57-ba1d-dee95f85606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:22.325401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c4c9a697-8200-4e57-ba1d-dee95f85606d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:22.326568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c4c9a697-8200-4e57-ba1d-dee95f85606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:22.335015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1211/2452] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:19:22.349406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:22.361602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71aeb-5dc5-4f2d-83b7-188e4a4e0dcb service nova] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:22.367202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:22.367806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:22.368091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:22.368369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:22.376645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:22.378280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:22.390304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1242/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:27.157394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:27.158103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:27.158103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:27.178362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:27.179602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:27.188811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1212/2454] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:27.205853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:27.211722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=72 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:27.217998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd847d-f382-4486-9f9e-bab47672a0db service nova] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:27.223536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb9c1e-0a89-4447-a9d7-796317b83283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:27.227161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb9c1e-0a89-4447-a9d7-796317b83283 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:27.227161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb9c1e-0a89-4447-a9d7-796317b83283 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:27.227161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb9c1e-0a89-4447-a9d7-796317b83283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:27.233441 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb9c1e-0a89-4447-a9d7-796317b83283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:27.235031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb9c1e-0a89-4447-a9d7-796317b83283 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:27.244569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1243/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:30.616997 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:30.625374 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=59 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:30.633653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d5740-d8f2-4ae9-8eb5-0e516bd058ec None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:30.641757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:30.641942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:30.642231 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:30.642578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:30.644440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:30.710995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:30.712822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:30.723595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1213/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:32.481505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10caffe-1703-40e5-b576-a403e53e6df2 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:32.481505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10caffe-1703-40e5-b576-a403e53e6df2 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:32.481505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10caffe-1703-40e5-b576-a403e53e6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:32.517585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b10caffe-1703-40e5-b576-a403e53e6df2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:32.520389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b10caffe-1703-40e5-b576-a403e53e6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:32.530357 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1244/2457] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:32.555097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:32.562142 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96afb-c45e-4def-b1ec-8eace43db88c service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:32.568226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:32.568886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:32.569201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:32.569472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:32.579062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:32.581069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:32.597322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1214/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:37.233429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0915b-2450-4838-98fc-3ec83c1f91a5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.233992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0915b-2450-4838-98fc-3ec83c1f91a5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.234090 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0915b-2450-4838-98fc-3ec83c1f91a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.253229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-4bd0915b-2450-4838-98fc-3ec83c1f91a5 None None] MFA Rules not processed for user `e5014c331aa04771ac313ffbd2ea19b9`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:37.254615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4bd0915b-2450-4838-98fc-3ec83c1f91a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.267101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1245/2459] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:37.589617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.599746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad41dfb-6cd7-451c-9038-3ef2952fa72a service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.603591 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.604193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.605153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.606833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.609413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.620769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.623759 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.633918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1215/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:37.784071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.784914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.784914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.796106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.818248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:37.825302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906c1d-0c9c-452f-afc0-e949dfe1c914 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.825594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.831017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.831584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1246/2461] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:37.832702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.832702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.832910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.835346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.850287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.852755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.867815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1216/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:37.930052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.947420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66a80-396c-41cc-89d7-c0edbfe30a0a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.954668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.955345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.955634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.955917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.976846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.978604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.002320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1247/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:38.180737 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.189149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:38.289060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d548-d931-40d5-8b2c-835f2b154320 service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.298209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.299053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.299342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.299624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.301456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:38.315415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.317126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c773e-c021-425e-8aba-864f8acadba8 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.334311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1217/2464] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:42.887319 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.888881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:42.901160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaaec6-1022-41a6-b0b7-0a774381c77b service nova] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.905208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.905821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.906109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.906392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.908141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:42.918911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.920394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.929167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1248/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:44.702176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.702739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.702739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.722480 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] MFA Rules not processed for user `bb7eabbe33b948e8af562ecc310a2bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:44.723689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:44.732090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1218/2466] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:19:45.149420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:45.159237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360120d-83be-4905-972d-4057de8014cc service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:45.164085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:45.164704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:45.165012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:45.165462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:45.168221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:45.179168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:45.180824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:45.192229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1249/2467] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:53.578232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.605267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ccd7-073a-45e1-98fe-1448cb9373cf None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.613426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.614056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.614342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.614621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.616675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:53.629948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.631551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4801d0-3e57-49e6-9426-89edbe697722 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.643376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1219/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:55.020451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:55.035418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a2fdd-1604-400e-87a8-0eec3b39d09d service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:55.045443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:55.046058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:55.046336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:55.046615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:55.048500 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:55.062329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:55.063936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb2ae4-9a39-4b24-af15-425af65e94fb service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:55.075965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1250/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:19:58.657029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.657617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.657727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.680980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] MFA Rules not processed for user `49c7d1102ab7443c81dd2de4d0d666b4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:58.682198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:58.689132 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1220/2470] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:05.071251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=38 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:08.675906 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:20.627526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328c78-b67e-448d-9edd-3d2a9f695378 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.628366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328c78-b67e-448d-9edd-3d2a9f695378 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.634350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328c78-b67e-448d-9edd-3d2a9f695378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.655130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5b328c78-b67e-448d-9edd-3d2a9f695378 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:20.656628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5b328c78-b67e-448d-9edd-3d2a9f695378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:20.666756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1251/2471] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:20.683534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:20.696767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a179ca-5c90-47f8-8876-57cd924a690a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:20.706988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9c953-4ea5-4c7c-901b-74dba7e73893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:20.706988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c953-4ea5-4c7c-901b-74dba7e73893 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:20.706988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c953-4ea5-4c7c-901b-74dba7e73893 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:20.706988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c953-4ea5-4c7c-901b-74dba7e73893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:20.714616 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c953-4ea5-4c7c-901b-74dba7e73893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:20.716776 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c953-4ea5-4c7c-901b-74dba7e73893 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:20.727194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1221/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:27.083045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:27.083540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:27.083638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:27.103164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:27.104404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:27.115059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:27.115559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:27.115662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:27.140089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:27.140674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:27.149009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1222/2473] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:27.165585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:27.173016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1252/2474] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 30 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:27.178244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91530d5b-4471-4139-b75c-b20b44de0dc7 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:27.184654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:27.185307 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:27.185602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:27.185877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:27.194907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:27.196504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:27.210016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1223/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:20:27.290711 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:27.292114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:27.368749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd72af-e690-47df-a01f-8958acd689f7 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:27.376198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67173ee-5ebe-41af-a301-3442e29b71e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:27.376812 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67173ee-5ebe-41af-a301-3442e29b71e8 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:27.377249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67173ee-5ebe-41af-a301-3442e29b71e8 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:27.377531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67173ee-5ebe-41af-a301-3442e29b71e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:27.388524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67173ee-5ebe-41af-a301-3442e29b71e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:27.390227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67173ee-5ebe-41af-a301-3442e29b71e8 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:27.399175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1253/2476] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:20:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:20:32.726951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:32.751295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dbb6e-3108-449f-835f-0620a8ee8e1c service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:32.758858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:32.759624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:32.760032 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:32.760546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:32.762969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:32.778079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:32.779560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:32.791709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1224/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:33.114852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:33.115407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:33.115407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:33.143679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:33.147964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:33.173394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1254/2478] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:33.191748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:33.210396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8d7a-9f5f-46e8-939f-1a2b19fd4ff5 service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:33.220787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049a216-e8bb-4c5d-b712-fb52d98dbe10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:33.221738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a216-e8bb-4c5d-b712-fb52d98dbe10 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:33.222017 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a216-e8bb-4c5d-b712-fb52d98dbe10 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:33.222504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a216-e8bb-4c5d-b712-fb52d98dbe10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:33.235393 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049a216-e8bb-4c5d-b712-fb52d98dbe10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:33.238059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049a216-e8bb-4c5d-b712-fb52d98dbe10 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:33.267613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1225/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:36.983389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:36.984960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:36.997704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58503e9f-d068-41e5-b033-72a125dc45cf None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:37.002333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:37.005628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:37.005628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:37.005628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] PATH_INFO: `/v3/users/09fad5976c834572bbf835c9193132b6` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:37.005628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fad5976c834572bbf835c9193132b6)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:37.006578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:37.242123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fad5976c834572bbf835c9193132b6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.242819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fad5976c834572bbf835c9193132b6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.250828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fad5976c834572bbf835c9193132b6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.373217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fad5976c834572bbf835c9193132b6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.383937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:37.386181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fad5976c834572bbf835c9193132b6'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.392498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1255/2480] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:36 2022] DELETE /identity/v3/users/09fad5976c834572bbf835c9193132b6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:37.443456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:37.443919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:37.444053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:37.464523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:37.465775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:37.534109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1226/2481] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:20:37.554037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:37.555043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:37.633321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520d2a-4bf5-40d0-9fe3-ad58b652933a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:37.639186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:37.639802 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:37.640086 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:37.640361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:37.648506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:37.650186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:37.660221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1256/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:37.717199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:37.721841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:37.733666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4a78-0eb6-45f0-a9af-859cece891db None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:37.738593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:37.739855 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:37.740152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:37.740436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] PATH_INFO: `/v3/projects/04224c1604d04d06895ccfb8230f0f7d` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:37.741619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04224c1604d04d06895ccfb8230f0f7d)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:37.743656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:37.864232 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04224c1604d04d06895ccfb8230f0f7d', 'request_id': 'req-5ad391e9-29f0-4a91-a960-2e9bef59af24'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.870430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04224c1604d04d06895ccfb8230f0f7d', 'request_id': 'req-5ad391e9-29f0-4a91-a960-2e9bef59af24'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.875942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04224c1604d04d06895ccfb8230f0f7d', 'request_id': 'req-5ad391e9-29f0-4a91-a960-2e9bef59af24'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.960351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] The token cache is being invalidate because project 04224c1604d04d06895ccfb8230f0f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:37.960674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.961355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:37.963457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1227/2483] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:37 2022] DELETE /identity/v3/projects/04224c1604d04d06895ccfb8230f0f7d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:37.968159 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:37.978221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64743-e92b-42a1-88a0-19e294ec05bc service nova] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:38.036648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:38.037328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:38.037581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:38.037859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] PATH_INFO: `/v3/users/9ec9888e20bf440c9b7eace7d916a9b7` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:38.038985 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec9888e20bf440c9b7eace7d916a9b7)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:38.040910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:38.209824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec9888e20bf440c9b7eace7d916a9b7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.210488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec9888e20bf440c9b7eace7d916a9b7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.217937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec9888e20bf440c9b7eace7d916a9b7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.326152 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec9888e20bf440c9b7eace7d916a9b7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.338991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-02bb3e24-40e7-4209-a0f3-87a2be64b346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec9888e20bf440c9b7eace7d916a9b7'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.340949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:38.345906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1257/2484] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:37 2022] DELETE /identity/v3/users/9ec9888e20bf440c9b7eace7d916a9b7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:38.643506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:38.645140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:38.675845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad391e9-29f0-4a91-a960-2e9bef59af24 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:38.696304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:38.733787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:38.734423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:38.734702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:38.734976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] PATH_INFO: `/v3/projects/e8f64a2c4335487bbd686f5a6dbf0748` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:38.736148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f64a2c4335487bbd686f5a6dbf0748)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:38.738165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:38.853511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f64a2c4335487bbd686f5a6dbf0748', 'request_id': 'req-40488af7-3f23-4106-b6b5-450a682c8e9f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.860280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f64a2c4335487bbd686f5a6dbf0748', 'request_id': 'req-40488af7-3f23-4106-b6b5-450a682c8e9f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.865936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f64a2c4335487bbd686f5a6dbf0748', 'request_id': 'req-40488af7-3f23-4106-b6b5-450a682c8e9f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.943121 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] The token cache is being invalidate because project e8f64a2c4335487bbd686f5a6dbf0748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:38.943413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.944037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:38.945540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1228/2485] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:38 2022] DELETE /identity/v3/projects/e8f64a2c4335487bbd686f5a6dbf0748 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:41.724083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:41.724615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:41.724733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:41.744105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:41.745356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:41.809462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1258/2486] 10.222.0.84 () {58 vars in 1016 bytes} [Tue Aug 30 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:41.826075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:41.827584 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:41.904714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40488af7-3f23-4106-b6b5-450a682c8e9f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:41.910454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:41.911066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:41.911364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:41.911689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:41.920297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:41.921949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:41.931730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1229/2487] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:49.407244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:49.408775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:49.477928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820531f8-3d5b-43e2-8abf-15838e3c4874 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:49.481530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:49.482136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:49.482422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:49.483413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:49.485295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:49.497414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:49.498842 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:49.508899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1259/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:51.927874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:53.208246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:53.209694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:53.280147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd289f-4118-492b-8aaa-45a81d5e0d9f service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:53.284955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:53.285585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:53.289236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:53.289236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:53.289236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:53.299954 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:53.301614 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:53.312718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1230/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:20:53.356529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:53.358783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:53.371966 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c165a-a877-4f70-b982-1af9c3ec0b65 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:53.378176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:53.380127 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:53.380406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:53.381808 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] PATH_INFO: `/v3/users/e785778ee1764ea9ade06b8c7515d0ae` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:53.381912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e785778ee1764ea9ade06b8c7515d0ae)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:53.383800 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:53.587143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e785778ee1764ea9ade06b8c7515d0ae'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.587908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e785778ee1764ea9ade06b8c7515d0ae'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.595834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e785778ee1764ea9ade06b8c7515d0ae'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.663446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e785778ee1764ea9ade06b8c7515d0ae'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.678010 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8cb4b006-6b2c-4a2a-ac2d-e659a1fc7d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e785778ee1764ea9ade06b8c7515d0ae'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:53.684427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1260/2490] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:20:53 2022] DELETE /identity/v3/users/e785778ee1764ea9ade06b8c7515d0ae => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:53.922368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:53.933599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1c285-f778-4f2b-85d1-8a612bc82f12 service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:53.993828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:53.994467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:53.994750 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:53.995023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] PATH_INFO: `/v3/projects/038604204df04c48a3176646016677ac` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:53.996144 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=038604204df04c48a3176646016677ac)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:53.998120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.115945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038604204df04c48a3176646016677ac', 'request_id': 'req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.122059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038604204df04c48a3176646016677ac', 'request_id': 'req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.128590 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038604204df04c48a3176646016677ac', 'request_id': 'req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.211333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] The token cache is being invalidate because project 038604204df04c48a3176646016677ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:20:54.211951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.212288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-e7deea7f-1187-42ee-84bf-74b40ec6fc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:20:54.213957 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1231/2491] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:20:53 2022] DELETE /identity/v3/projects/038604204df04c48a3176646016677ac => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:54.219535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.219826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.220110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.240279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:54.241523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:54.249838 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:54.300702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1261/2492] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:54.308323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.308619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.308979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.331001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:54.332513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:54.340470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1232/2493] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:54.345602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.355446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d454a36-df32-4a9f-8f2f-be6416625b2d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.360472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.361135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.361425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.361708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.362413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:54.362745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.364342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.376341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1262/2494] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:54.380610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.390340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c20dd-d50a-4156-bcd2-62ee4902e306 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.395106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.395742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.395742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.396257 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.396893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.398819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.410757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:54.540105 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1233/2495] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:54.544432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.554713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68e07-d4da-4757-bd36-acbc4df6d651 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.612536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.613178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.613469 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.613750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.614401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.616356 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.739204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1263/2496] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:54.742956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.754989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa62b8-9dc6-4c45-87aa-c7b573d7b059 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.759610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.760217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.760499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.760790 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.761454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.763050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.774438 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1234/2497] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:54.778859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.790775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f31be-e0f1-4fec-b199-49a7c5db3c4c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.796038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302f90-b667-464b-9df5-5c169418471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.796747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302f90-b667-464b-9df5-5c169418471c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.797063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302f90-b667-464b-9df5-5c169418471c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.797388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302f90-b667-464b-9df5-5c169418471c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.798052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c302f90-b667-464b-9df5-5c169418471c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.799676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c302f90-b667-464b-9df5-5c169418471c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.810793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1264/2498] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:54.815845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:54.826233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157ec01-f598-494d-aedf-353ea48d72d7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:54.831769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:54.832693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.833080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.833417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] PATH_INFO: `/v3/projects/b0c1daaae63d45fb8fe4a46b84fab954/users/4c3c28c8895e4112b106530cd6408943/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.849365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c1daaae63d45fb8fe4a46b84fab954, user_id=4c3c28c8895e4112b106530cd6408943, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:54.852295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:54.949847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1235/2499] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:20:54 2022] PUT /identity/v3/projects/b0c1daaae63d45fb8fe4a46b84fab954/users/4c3c28c8895e4112b106530cd6408943/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:20:54.961861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:54.962128 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:54.962401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:54.992215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] MFA Rules not processed for user `4c3c28c8895e4112b106530cd6408943`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:54.993433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.058729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1265/2500] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:20:55.070361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:55.072115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:55.150505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a842b59-5fc4-4375-a868-cafe7e487f7e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:55.156034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5ced5-0822-45f2-bd80-bd50c060ff0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:55.156798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5ced5-0822-45f2-bd80-bd50c060ff0a service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:55.157206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5ced5-0822-45f2-bd80-bd50c060ff0a service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:55.157485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5ced5-0822-45f2-bd80-bd50c060ff0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:55.165084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5ced5-0822-45f2-bd80-bd50c060ff0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:55.166712 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5ced5-0822-45f2-bd80-bd50c060ff0a service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:55.176197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1236/2501] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:01.471446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:01.481214 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:01.537389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66368-8b0c-4458-9c6e-948d70dc9ef6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:01.542034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:01.542670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:01.542958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:01.543244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] PATH_INFO: `/v3/users/4c3c28c8895e4112b106530cd6408943` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:01.544375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3c28c8895e4112b106530cd6408943)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:01.546345 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:01.757804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3c28c8895e4112b106530cd6408943'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:01.758468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3c28c8895e4112b106530cd6408943'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:01.765409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3c28c8895e4112b106530cd6408943'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:01.851678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3c28c8895e4112b106530cd6408943'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:01.864783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3c28c8895e4112b106530cd6408943'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:01.871298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1266/2502] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:01 2022] DELETE /identity/v3/users/4c3c28c8895e4112b106530cd6408943 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:01.875985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:01.876495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:01.876593 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:01.896274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:01.902576 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:01.961941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1237/2503] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:01.971651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:01.973259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:02.032868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190b621-9245-403e-aa42-ac6ab2f54a16 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:02.036592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224e328-34e9-4b54-a659-86f0bbddda02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:02.037245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e328-34e9-4b54-a659-86f0bbddda02 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:02.039954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e328-34e9-4b54-a659-86f0bbddda02 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:02.039954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e328-34e9-4b54-a659-86f0bbddda02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:02.046817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224e328-34e9-4b54-a659-86f0bbddda02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:02.048257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224e328-34e9-4b54-a659-86f0bbddda02 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:02.058848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1267/2504] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:02.494392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:02.497199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:02.514443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45405f-9142-4c97-97e4-96bf7c7a2ff3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:02.524127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:02.524904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:02.525306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:02.525482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] PATH_INFO: `/v3/projects/b0c1daaae63d45fb8fe4a46b84fab954` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:02.526756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c1daaae63d45fb8fe4a46b84fab954)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:02.528563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:02.708079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:02.719297 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c1daaae63d45fb8fe4a46b84fab954', 'request_id': 'req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:02.726263 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c1daaae63d45fb8fe4a46b84fab954', 'request_id': 'req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:02.731662 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c1daaae63d45fb8fe4a46b84fab954', 'request_id': 'req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:02.898472 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] The token cache is being invalidate because project b0c1daaae63d45fb8fe4a46b84fab954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:02.899099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:02.899322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-8b1a6c9b-f97f-4edc-ba3f-bf7b0c98cc33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:02.900836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1238/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:02 2022] DELETE /identity/v3/projects/b0c1daaae63d45fb8fe4a46b84fab954 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:02.906218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:02.906663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:02.906770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:02.926311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:02.927507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:02.953798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:02.987100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1268/2506] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:02.995238 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:02.995540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:02.995916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.027260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:03.028493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:03.036801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1239/2507] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:03.043308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.053429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dd9f0-f3f1-434e-a471-8a38ae4793b9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.058666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.059281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.059567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.059848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.060501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:03.060811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.062458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.074899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1269/2508] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:21:03.079293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.089881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a00699-9b52-4c0e-a216-b9505495c63b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.095268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.095873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.096156 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.096433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.097104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.099636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.242258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1240/2509] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:03 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:03.246606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.256914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4a08-470a-4843-8029-7fd9314f057a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.318789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.319396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.319682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.319959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.320592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.322551 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.452791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1270/2510] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:03 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:03.457892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.468314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628016d5-7140-409b-8edd-68c6495321d6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.473626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.474226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.474511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.474791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.475434 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.477067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.487235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1241/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:03.491481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.501720 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b97b6-9a19-4096-899b-2b11cfeb6469 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.507068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344c6d-3670-47ba-a03c-304480ec1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.507244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344c6d-3670-47ba-a03c-304480ec1023 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.507696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344c6d-3670-47ba-a03c-304480ec1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.507696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344c6d-3670-47ba-a03c-304480ec1023 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.508348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344c6d-3670-47ba-a03c-304480ec1023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.510051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344c6d-3670-47ba-a03c-304480ec1023 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.522365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1271/2512] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:03.526768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.537756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05008fb7-ff6f-4e19-8da5-051b74cf838a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.542553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.543215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.543505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.543786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] PATH_INFO: `/v3/projects/956a6b32de494b84898d2ce14298f5b1/users/e0f0dc5b423a4f119a92be892dae036e/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.558804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956a6b32de494b84898d2ce14298f5b1, user_id=e0f0dc5b423a4f119a92be892dae036e, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.561567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.679731 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1242/2513] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:03 2022] PUT /identity/v3/projects/956a6b32de494b84898d2ce14298f5b1/users/e0f0dc5b423a4f119a92be892dae036e/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:03.690443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.690753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.691037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.722149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] MFA Rules not processed for user `e0f0dc5b423a4f119a92be892dae036e`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:03.724433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:03.795715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1272/2514] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:03.800846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.866713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f3c8f-1394-4a4d-a84c-3ac7519a7b61 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:03.871403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:03.872009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:03.872286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:03.872562 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:03.873256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:03.875153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:03.967739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1243/2515] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:03 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:03.971914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:03.982876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb6b4-c770-44f5-81b4-285b35aa885b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.013313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:04.047420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.048047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.048330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.048605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.049303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:04.052748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:04.146863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1273/2516] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:03 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:04.151505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:04.162335 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb7e9-5809-4f02-a5b2-a2e2bedcf50d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.167294 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.167901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.168188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.168514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.169202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:04.170892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:04.182426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1244/2517] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:04.189956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:04.201521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf9bb0-ffaf-43d6-a865-e0bd23f9f09a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.208761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.210078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.210078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.210078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] PATH_INFO: `/v3/projects/670cc78ce93346598bb955c00d35eed6/users/96a3dbb64a5f477ca25778b4f5bb033d/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.225944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670cc78ce93346598bb955c00d35eed6, user_id=96a3dbb64a5f477ca25778b4f5bb033d, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:04.228810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:04.361432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1274/2518] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:04 2022] PUT /identity/v3/projects/670cc78ce93346598bb955c00d35eed6/users/96a3dbb64a5f477ca25778b4f5bb033d/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:04.366223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:04.376356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbbac-02c9-4231-8801-75651e84cf3b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.410702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:04.435306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5303a-2872-4c0e-9f5e-19a3610e5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.435921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5303a-2872-4c0e-9f5e-19a3610e5921 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.436209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5303a-2872-4c0e-9f5e-19a3610e5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.436491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5303a-2872-4c0e-9f5e-19a3610e5921 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.437175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5303a-2872-4c0e-9f5e-19a3610e5921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:04.438791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5303a-2872-4c0e-9f5e-19a3610e5921 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:04.451713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1245/2519] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:04.453627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:04.465005 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b4ab4-7bc4-4bae-a55b-a066b856b151 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.470229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.470885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.471184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.471466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] PATH_INFO: `/v3/projects/670cc78ce93346598bb955c00d35eed6/users/96a3dbb64a5f477ca25778b4f5bb033d/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.473997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670cc78ce93346598bb955c00d35eed6, user_id=96a3dbb64a5f477ca25778b4f5bb033d, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:04.476633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:04.486986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1275/2520] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:04 2022] PUT /identity/v3/projects/670cc78ce93346598bb955c00d35eed6/users/96a3dbb64a5f477ca25778b4f5bb033d/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:04.498988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.499277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.499549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.527811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] MFA Rules not processed for user `96a3dbb64a5f477ca25778b4f5bb033d`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:04.529068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:04.608469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1246/2521] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:04.620589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:04.622384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:04.686235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b453a-57d5-4825-b42e-17663357ae34 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.690984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.691724 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.692122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.692497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:04.703153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:04.704829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:04.716157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1276/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:04.946668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:04.956364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112db92-ff08-4734-bace-8c38ac4e904c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:04.961251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10550336-e154-46b0-abd3-79995cc4f51e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:04.962036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550336-e154-46b0-abd3-79995cc4f51e service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:04.962321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550336-e154-46b0-abd3-79995cc4f51e service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:04.962642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10550336-e154-46b0-abd3-79995cc4f51e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:05.022390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10550336-e154-46b0-abd3-79995cc4f51e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:05.023923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10550336-e154-46b0-abd3-79995cc4f51e service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:05.033110 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1247/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:13.935185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:13.999533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44b9a3-3a4c-4c27-a9b8-ff0d14d41dec service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:14.005217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:14.005860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:14.006255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:14.006416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] PATH_INFO: `/v3/users/e0f0dc5b423a4f119a92be892dae036e` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:14.007555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f0dc5b423a4f119a92be892dae036e)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:14.009595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:14.034211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:14.313198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f0dc5b423a4f119a92be892dae036e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:14.313978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f0dc5b423a4f119a92be892dae036e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:14.322492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f0dc5b423a4f119a92be892dae036e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:14.423167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f0dc5b423a4f119a92be892dae036e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:14.436903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f0dc5b423a4f119a92be892dae036e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:14.443891 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1277/2524] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:13 2022] DELETE /identity/v3/users/e0f0dc5b423a4f119a92be892dae036e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:14.449099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:14.449601 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:14.449714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:14.469821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:14.471016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:14.523510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:14.534775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1248/2525] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:14.545008 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:14.546411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:14.603777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115fc4-75db-4558-9765-13d88291874b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:14.607452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:14.608048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:14.608327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:14.608601 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:14.618738 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:14.620221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:14.631072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1278/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:15.037896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:15.039797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:15.057254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce051f-6c33-4e67-b42e-ab068a5669d2 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:15.062141 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:15.062941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:15.065495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:15.065495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] PATH_INFO: `/v3/projects/956a6b32de494b84898d2ce14298f5b1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:15.065495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956a6b32de494b84898d2ce14298f5b1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:15.067915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:15.196559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956a6b32de494b84898d2ce14298f5b1', 'request_id': 'req-1534a84e-94fc-414f-bae0-989d5b566384'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.204015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956a6b32de494b84898d2ce14298f5b1', 'request_id': 'req-1534a84e-94fc-414f-bae0-989d5b566384'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.213409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956a6b32de494b84898d2ce14298f5b1', 'request_id': 'req-1534a84e-94fc-414f-bae0-989d5b566384'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.286039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] The token cache is being invalidate because project 956a6b32de494b84898d2ce14298f5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:15.286622 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.287002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.288548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1249/2527] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:15 2022] DELETE /identity/v3/projects/956a6b32de494b84898d2ce14298f5b1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:15.292643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:15.311415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2786d-56c1-429e-8c4c-70b971c7c12d service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:15.385931 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:15.386627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:15.386906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:15.387178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] PATH_INFO: `/v3/users/96a3dbb64a5f477ca25778b4f5bb033d` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:15.388389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a3dbb64a5f477ca25778b4f5bb033d)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:15.393324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:15.572801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:15.574961 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a3dbb64a5f477ca25778b4f5bb033d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.575638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a3dbb64a5f477ca25778b4f5bb033d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.583847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a3dbb64a5f477ca25778b4f5bb033d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.664427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a3dbb64a5f477ca25778b4f5bb033d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.679154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ae428c0a-4ec3-4d21-8439-a6175f6a081e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a3dbb64a5f477ca25778b4f5bb033d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:15.685690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1279/2528] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:15 2022] DELETE /identity/v3/users/96a3dbb64a5f477ca25778b4f5bb033d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:16.163325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:16.165051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:16.178527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a84e-94fc-414f-bae0-989d5b566384 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:16.239339 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:16.240011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:16.240325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:16.240603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] PATH_INFO: `/v3/projects/670cc78ce93346598bb955c00d35eed6` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:16.241772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670cc78ce93346598bb955c00d35eed6)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:16.243741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:16.366696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670cc78ce93346598bb955c00d35eed6', 'request_id': 'req-87dd9a65-e683-4a5c-ae30-5f87875ae788'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:16.372812 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670cc78ce93346598bb955c00d35eed6', 'request_id': 'req-87dd9a65-e683-4a5c-ae30-5f87875ae788'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:16.379888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670cc78ce93346598bb955c00d35eed6', 'request_id': 'req-87dd9a65-e683-4a5c-ae30-5f87875ae788'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:16.497289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] The token cache is being invalidate because project 670cc78ce93346598bb955c00d35eed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:16.497504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:16.498112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-87dd9a65-e683-4a5c-ae30-5f87875ae788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:16.499598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1250/2529] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:16 2022] DELETE /identity/v3/projects/670cc78ce93346598bb955c00d35eed6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:16.505312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:16.511886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:16.511886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:16.526979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:16.528192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:16.589430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1280/2530] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:16.596719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:16.597044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:16.597326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:16.616771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:16.618005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:16.625899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1251/2531] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:16.631110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:16.641068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba32af-933a-4002-82a6-5bb11e33fdfe None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:16.646283 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:16.646874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:16.647184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:16.647457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:16.648131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:16.648435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:16.650185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:16.661726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1281/2532] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:21:16.666099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:16.670686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:16.676001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73a84a-8d8e-4051-bf26-f2f6af298aa3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:16.680990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:16.681738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:16.682025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:16.682311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:16.683021 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:16.684989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:16.784814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1252/2533] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:16 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:16.789804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:16.799959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f25025-0ff5-4b43-95db-3dbe06946a6c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:16.869708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:16.873439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:16.873439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:16.873439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:16.873439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:16.873774 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:16.978866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1282/2534] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:16 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:16.983268 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:16.994114 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b372-e509-4422-8088-c461fbf984e9 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.001937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.001937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.001937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.001937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.002326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.002423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.013520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1253/2535] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:17.017580 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.027648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4477ada-110b-433f-9fe3-39e4be246a31 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.032229 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11c932-fcfa-4190-9435-0b68790233c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.033871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c932-fcfa-4190-9435-0b68790233c5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.033871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c932-fcfa-4190-9435-0b68790233c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.033871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c932-fcfa-4190-9435-0b68790233c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.034155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11c932-fcfa-4190-9435-0b68790233c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.035860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11c932-fcfa-4190-9435-0b68790233c5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.046509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1283/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:17.051210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.061495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6df29-80e9-45ce-b2c9-32265026e1ed admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.066280 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.067473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.067775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.068152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] PATH_INFO: `/v3/projects/6de92aaa65174f1796768741d4366dfa/users/b90eadcccc044138a35a8229821df99f/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.083188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de92aaa65174f1796768741d4366dfa, user_id=b90eadcccc044138a35a8229821df99f, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.085960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.154938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1254/2537] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:17 2022] PUT /identity/v3/projects/6de92aaa65174f1796768741d4366dfa/users/b90eadcccc044138a35a8229821df99f/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:17.166402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.166694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.166982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.195257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] MFA Rules not processed for user `b90eadcccc044138a35a8229821df99f`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:17.196512 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:17.213253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:17.261238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1284/2538] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:17.265726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.334134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac6259-0e57-4eb2-b4ed-42184f0d1ca6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.338986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.339623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.339924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.340185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.340827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.342766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.442818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1255/2539] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:17.447048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.458635 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4461-27ab-4df5-9262-cced9c031243 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.514884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.515541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.515777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.516058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.516751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.518747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.630018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1285/2540] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:17.633995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.644454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675f114-547f-461b-b717-f55b4359681f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.649329 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.649931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.650249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.650529 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.651176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.652779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.663653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1256/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:17.667743 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.678471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98630a-c1ab-4f14-b4d5-86b85e374a21 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.683102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.683755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.684041 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.684321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] PATH_INFO: `/v3/projects/bc2de6683a6243b59ac6b20caa6cc172/users/f8aed216e1bf4b7a86b8ede25e039db2/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.699522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2de6683a6243b59ac6b20caa6cc172, user_id=f8aed216e1bf4b7a86b8ede25e039db2, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.702227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.787828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1286/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:17 2022] PUT /identity/v3/projects/bc2de6683a6243b59ac6b20caa6cc172/users/f8aed216e1bf4b7a86b8ede25e039db2/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:17.793361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.804101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed040-b5e8-4a53-aca8-ce964630f019 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.860773 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21fe5-76a1-4601-b8c9-ca56c462693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.861421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21fe5-76a1-4601-b8c9-ca56c462693f admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.861708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21fe5-76a1-4601-b8c9-ca56c462693f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.861991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21fe5-76a1-4601-b8c9-ca56c462693f admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.862670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21fe5-76a1-4601-b8c9-ca56c462693f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.868475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21fe5-76a1-4601-b8c9-ca56c462693f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.882282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1257/2543] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:17.886410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:17.897955 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735182-5010-4b24-979b-761e722c6367 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:17.905474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:17.906257 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.906549 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.906831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] PATH_INFO: `/v3/projects/bc2de6683a6243b59ac6b20caa6cc172/users/f8aed216e1bf4b7a86b8ede25e039db2/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.908783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2de6683a6243b59ac6b20caa6cc172, user_id=f8aed216e1bf4b7a86b8ede25e039db2, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:17.912003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:17.926584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1287/2544] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:17 2022] PUT /identity/v3/projects/bc2de6683a6243b59ac6b20caa6cc172/users/f8aed216e1bf4b7a86b8ede25e039db2/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:17.938168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.938461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.938746 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.982321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] MFA Rules not processed for user `f8aed216e1bf4b7a86b8ede25e039db2`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:17.982321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:17.982321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:18.055463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1258/2545] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:18.068249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:18.069998 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:18.127755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da920030-74de-466e-8f24-7aee4e23bc87 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:18.131726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f087ef3-78c0-41d3-bf80-6332098a40fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:18.132279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f087ef3-78c0-41d3-bf80-6332098a40fb service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:18.132706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f087ef3-78c0-41d3-bf80-6332098a40fb service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:18.132883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f087ef3-78c0-41d3-bf80-6332098a40fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:18.142117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f087ef3-78c0-41d3-bf80-6332098a40fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:18.143555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f087ef3-78c0-41d3-bf80-6332098a40fb service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:18.161349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1288/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:19.023789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:19.086858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d703f-86c0-4939-9701-be516b6b4e6b None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:19.091574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:19.092204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:19.092485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:19.092760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] PATH_INFO: `/v3/users/b90eadcccc044138a35a8229821df99f` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:19.093907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90eadcccc044138a35a8229821df99f)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:19.095819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:19.283460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90eadcccc044138a35a8229821df99f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:19.292309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90eadcccc044138a35a8229821df99f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:19.293109 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90eadcccc044138a35a8229821df99f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:19.293844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90eadcccc044138a35a8229821df99f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:19.377791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90eadcccc044138a35a8229821df99f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:19.397394 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1259/2547] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:19 2022] DELETE /identity/v3/users/b90eadcccc044138a35a8229821df99f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:19.401926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:19.402404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:19.402520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:19.421180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:19.422416 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:19.431032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:19.481489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1289/2548] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:19.491620 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:19.493154 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:19.517583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:19.554193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb70927-e48f-4b00-a6af-e985b822586e admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:19.557834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:19.558447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:19.558734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:19.559028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:19.568837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:19.570299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:19.579927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1260/2549] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:20.036779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:20.038294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:20.051298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ff66-54bb-4859-9273-2f57e30b4d39 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:20.056164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:20.056805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:20.057117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:20.057394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] PATH_INFO: `/v3/projects/6de92aaa65174f1796768741d4366dfa` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:20.058722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de92aaa65174f1796768741d4366dfa)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:20.063833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:20.169049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de92aaa65174f1796768741d4366dfa', 'request_id': 'req-677ab350-35e0-4b53-96c8-2ad142d0d2c0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.274455 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de92aaa65174f1796768741d4366dfa', 'request_id': 'req-677ab350-35e0-4b53-96c8-2ad142d0d2c0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.281328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de92aaa65174f1796768741d4366dfa', 'request_id': 'req-677ab350-35e0-4b53-96c8-2ad142d0d2c0'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.291750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] The token cache is being invalidate because project 6de92aaa65174f1796768741d4366dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:20.292043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.292689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.294206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1290/2550] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:20 2022] DELETE /identity/v3/projects/6de92aaa65174f1796768741d4366dfa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:20.298310 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:20.308137 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649667e-c71c-441e-8ced-2756fe39f2a9 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:20.366381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:20.367015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:20.367303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:20.367582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] PATH_INFO: `/v3/users/f8aed216e1bf4b7a86b8ede25e039db2` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:20.368734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8aed216e1bf4b7a86b8ede25e039db2)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:20.370738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:20.563038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8aed216e1bf4b7a86b8ede25e039db2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.570727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8aed216e1bf4b7a86b8ede25e039db2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.571396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8aed216e1bf4b7a86b8ede25e039db2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.572011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8aed216e1bf4b7a86b8ede25e039db2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.663039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8aed216e1bf4b7a86b8ede25e039db2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:20.681644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1261/2551] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:20 2022] DELETE /identity/v3/users/f8aed216e1bf4b7a86b8ede25e039db2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:21.185367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.191027 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.200526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab350-35e0-4b53-96c8-2ad142d0d2c0 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:21.263471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:21.264118 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.264408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.264690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] PATH_INFO: `/v3/projects/bc2de6683a6243b59ac6b20caa6cc172` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.265928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2de6683a6243b59ac6b20caa6cc172)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:21.267869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:21.368068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:21.374871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2de6683a6243b59ac6b20caa6cc172', 'request_id': 'req-61d200ca-6b22-4608-b9d4-eab9b1b84f46'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.463402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2de6683a6243b59ac6b20caa6cc172', 'request_id': 'req-61d200ca-6b22-4608-b9d4-eab9b1b84f46'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.465631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.467364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.470896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2de6683a6243b59ac6b20caa6cc172', 'request_id': 'req-61d200ca-6b22-4608-b9d4-eab9b1b84f46'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.485115 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc87f-a3e7-41f3-a268-83f8135eb595 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:21.485272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] The token cache is being invalidate because project bc2de6683a6243b59ac6b20caa6cc172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:21.485272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.485272 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-61d200ca-6b22-4608-b9d4-eab9b1b84f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.486054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1291/2552] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:21 2022] DELETE /identity/v3/projects/bc2de6683a6243b59ac6b20caa6cc172 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:21.490901 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9bb6b-d640-4b19-add6-57ca8c581edc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.491489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9bb6b-d640-4b19-add6-57ca8c581edc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.491783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9bb6b-d640-4b19-add6-57ca8c581edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.512594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b0d9bb6b-d640-4b19-add6-57ca8c581edc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:21.513881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b0d9bb6b-d640-4b19-add6-57ca8c581edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.532002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:21.550244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:21.551038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.551525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.551959 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] PATH_INFO: `/v3/users/49c7d1102ab7443c81dd2de4d0d666b4` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.553309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c7d1102ab7443c81dd2de4d0d666b4)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:21.555226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:21.578981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1292/2553] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:21.587761 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.588054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.588337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.609119 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:21.610336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.618732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1293/2554] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:21.623350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.633437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf63f6-1295-407b-a5fc-eb5c5a027b94 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:21.638839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:21.642354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.642354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.642354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.642354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:21.642354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:21.642798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:21.654828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1294/2555] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:21:21.659105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.668695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6ea0f-6657-4993-aefa-79bfcfebcab0 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:21.673435 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:21.674035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.674303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.674581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.675205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:21.677247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:21.739461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c7d1102ab7443c81dd2de4d0d666b4'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.746410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c7d1102ab7443c81dd2de4d0d666b4'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.747120 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c7d1102ab7443c81dd2de4d0d666b4'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.747798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c7d1102ab7443c81dd2de4d0d666b4'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.756324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1295/2556] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:21 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:21.760336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.761944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.811849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c7d1102ab7443c81dd2de4d0d666b4'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:21.826114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e877ee8-8bc6-49e7-9796-311c69a4b298 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:21.829960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1262/2557] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:21 2022] DELETE /identity/v3/users/49c7d1102ab7443c81dd2de4d0d666b4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:21.836882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:21.837575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.838006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.838286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.838941 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:21.840886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:21.926948 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1296/2558] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:21 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:21.931194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.996333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf18b-f1d5-4b39-9283-b72aa003d44c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.001064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.001709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.001968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.002249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.005413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.005413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.015804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1263/2559] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:21:22.020026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.030171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0feaa2-9562-4bdb-8bdc-64a5a68f9982 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.034926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.035810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.036421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.036421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.037114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.038728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.048669 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1297/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:22.053803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.063832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dad77-2ce9-4c98-bda6-f896d433c216 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.069497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c0bf8-e73d-4151-8e3d-bde55af65b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.074318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c0bf8-e73d-4151-8e3d-bde55af65b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.074318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c0bf8-e73d-4151-8e3d-bde55af65b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.074318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c0bf8-e73d-4151-8e3d-bde55af65b01 admin admin] PATH_INFO: `/v3/projects/1b56a8fa609a4399be5ca2da2efab38b/users/dfacee0a8c5842d082c8e7a0696969c7/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.077093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.078841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:22.088906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:22.093052 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793275-129a-40ac-a66e-00388d2cab66 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.094594 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c0bf8-e73d-4151-8e3d-bde55af65b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b56a8fa609a4399be5ca2da2efab38b, user_id=dfacee0a8c5842d082c8e7a0696969c7, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.097803 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c0bf8-e73d-4151-8e3d-bde55af65b01 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.098107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.098944 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.099133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.099418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] PATH_INFO: `/v3/projects/4dacc6dc53c7454ba914fb668428e6df` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.100625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dacc6dc53c7454ba914fb668428e6df)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.102602 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.201166 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1264/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:22 2022] PUT /identity/v3/projects/1b56a8fa609a4399be5ca2da2efab38b/users/dfacee0a8c5842d082c8e7a0696969c7/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:22.213155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.213446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.213727 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.237263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dacc6dc53c7454ba914fb668428e6df', 'request_id': 'req-6b717933-6a7a-4b8f-b34f-fe51327c477c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:22.244084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] MFA Rules not processed for user `dfacee0a8c5842d082c8e7a0696969c7`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:22.245359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:22.265868 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:22.287037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dacc6dc53c7454ba914fb668428e6df', 'request_id': 'req-6b717933-6a7a-4b8f-b34f-fe51327c477c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:22.294182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dacc6dc53c7454ba914fb668428e6df', 'request_id': 'req-6b717933-6a7a-4b8f-b34f-fe51327c477c'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:22.305593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] The token cache is being invalidate because project 4dacc6dc53c7454ba914fb668428e6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:22.305889 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:22.306556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-6b717933-6a7a-4b8f-b34f-fe51327c477c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:22.308100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1298/2562] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:22 2022] DELETE /identity/v3/projects/4dacc6dc53c7454ba914fb668428e6df => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:22.312755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1265/2563] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:22.312900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348123-fb6b-46de-a5fd-e6016b4b0392 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.313139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348123-fb6b-46de-a5fd-e6016b4b0392 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.313524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348123-fb6b-46de-a5fd-e6016b4b0392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.317905 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.334162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ec348123-fb6b-46de-a5fd-e6016b4b0392 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:22.335404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ec348123-fb6b-46de-a5fd-e6016b4b0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:22.385085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9f562-560d-4aa0-9ac7-6513b51ab2e8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.389953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.390610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.390897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.391180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.391815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.393764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.397063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1299/2564] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:22.404959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.405255 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.405540 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.425439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:22.427028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:22.445311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1300/2565] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:22.448029 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.457693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9a7b0-824d-4230-8fd7-f1d44b1c3530 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.462520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.463097 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.463379 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.463657 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.464290 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:22.464592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.466211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.477775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1301/2566] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:21:22.481861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.491199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20b1b-ebb1-4232-a603-5be94c478824 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.497336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.498198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.498618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.499070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.500032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.502957 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.528974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1266/2567] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:22.532634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.534318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:22.574839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1302/2568] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:22.578596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.611429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4359d-ad74-4ae2-89b9-52d0c2ed918a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.630101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:22.646364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dceea5-89b9-476a-aa92-2513b8108e63 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.651317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.651933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.652227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.652504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.653261 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.655238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.664316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:22.670902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.671615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.671883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.672158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.672788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.674798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.738938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1303/2569] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:22.743024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.755369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fafb7f-c93c-45db-bda7-9c5955e1faa5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.756981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1267/2570] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:22.762661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.762661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.762661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.762661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.763037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.763876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.763989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.774491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682282d6-0e9e-4dd7-b54d-e2974e0463bd admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.774690 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1304/2571] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:21:22.778525 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.779628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.780446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.780795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.781174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.781891 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.783564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.788781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb85a81-854d-4c16-8619-7c211b20423b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.793561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.794168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.797618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1268/2572] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:22.797770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.797770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.797770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.797770 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.798613 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.808728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1305/2573] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:21:22.809183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce4f9-58cc-4c4c-81da-888f5791ce37 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.813944 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.814598 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.814883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.815164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] PATH_INFO: `/v3/projects/38296d6411494818b20a6ccf1f8ca9b4/users/48366fcebf7c4fb9bea655f4c8983ee0/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.815682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.826034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f699e-7a12-4279-879d-035a381d37ff admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:22.830755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=38296d6411494818b20a6ccf1f8ca9b4, user_id=48366fcebf7c4fb9bea655f4c8983ee0, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.831613 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f3e61-4e23-40b0-8abb-ec43d328c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:22.832323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f3e61-4e23-40b0-8abb-ec43d328c26c admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.832600 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f3e61-4e23-40b0-8abb-ec43d328c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.833143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f3e61-4e23-40b0-8abb-ec43d328c26c admin admin] PATH_INFO: `/v3/projects/85ec83686a094c32b0484fff088fbe3f/users/6b90f274167943498168b681f173a7d3/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.833792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.847655 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f3e61-4e23-40b0-8abb-ec43d328c26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ec83686a094c32b0484fff088fbe3f, user_id=6b90f274167943498168b681f173a7d3, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:22.850476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f3e61-4e23-40b0-8abb-ec43d328c26c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:22.922918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1269/2574] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:22 2022] PUT /identity/v3/projects/38296d6411494818b20a6ccf1f8ca9b4/users/48366fcebf7c4fb9bea655f4c8983ee0/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:22.927500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:22.959412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1306/2575] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:22 2022] PUT /identity/v3/projects/85ec83686a094c32b0484fff088fbe3f/users/6b90f274167943498168b681f173a7d3/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:22.968537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:22.968954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:22.969350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:22.991193 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:22.992413 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:22.996951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c034f-3340-4cc1-80d5-ac362648fdac admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:23.053438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1307/2576] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:23.057515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:23.058155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.058434 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.058709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.059356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:23.061000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:23.063650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:23.065026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:23.072546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1270/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:21:23.077253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:23.087357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ceb7-4982-4753-b290-e853e1d9aaad admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:23.092041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e001-ff82-4382-ac8e-b8c10c5a26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:23.092686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e001-ff82-4382-ac8e-b8c10c5a26f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.092987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e001-ff82-4382-ac8e-b8c10c5a26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.093264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e001-ff82-4382-ac8e-b8c10c5a26f1 admin admin] PATH_INFO: `/v3/projects/38296d6411494818b20a6ccf1f8ca9b4/users/48366fcebf7c4fb9bea655f4c8983ee0/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.095182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e001-ff82-4382-ac8e-b8c10c5a26f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38296d6411494818b20a6ccf1f8ca9b4, user_id=48366fcebf7c4fb9bea655f4c8983ee0, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:23.098354 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e001-ff82-4382-ac8e-b8c10c5a26f1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:23.108398 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1271/2578] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:23 2022] PUT /identity/v3/projects/38296d6411494818b20a6ccf1f8ca9b4/users/48366fcebf7c4fb9bea655f4c8983ee0/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:23.119331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.119625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.119909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.133954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceda49-7c5b-4a91-8b3d-a82f21f3e892 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:23.150791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] MFA Rules not processed for user `48366fcebf7c4fb9bea655f4c8983ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:23.152042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:23.179151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:23.183767 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:23.190773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:23.190773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.190773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.190773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.232173 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1272/2579] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:23.244501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:23.246387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:23.253939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:23.259062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:23.265515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1308/2580] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:23.304843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc6b2-aa29-449c-ba98-beff3c73c020 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:23.308556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:23.309201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.309485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.315419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.315419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:23.371564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:23.373138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cbcd9-26d4-4195-b471-1c9af6ffe523 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:23.383245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1273/2581] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:25.136021 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:25.139168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:25.152856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5037362-022a-4c81-9781-f5723dcf1e38 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:25.157298 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:25.158059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:25.158421 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:25.158796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:25.171013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:25.172675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:25.184191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1309/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:28.834092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:28.834652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:28.834652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:28.867061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] MFA Rules not processed for user `6b90f274167943498168b681f173a7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:28.868469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:28.946494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1274/2583] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:28.951051 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:28.969866 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2613e-e13c-4a49-a4ac-ec06e4676c6e service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:28.975845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:28.976458 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:28.976742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:28.977048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:28.977699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:28.979606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.192660 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1310/2584] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:28 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:29.197019 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:29.210004 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6c6bb-adec-40c9-ae08-1682d6ca57d1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:29.215540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:29.271969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:29.272585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:29.272908 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:29.273220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:29.273877 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:29.275826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.377873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1275/2585] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:29 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:21:29.382485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:29.393055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a421f0-9ea2-46bc-81ea-96dc6c744518 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:29.403652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:29.403652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:29.403652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:29.403652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:29.404162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:29.404162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.412456 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1311/2586] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:29.418560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:29.431101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de16a1-390c-4975-9979-2f4a24248f02 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:29.436379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:29.437077 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:29.437366 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:29.437643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] PATH_INFO: `/v3/projects/61b14823e48048ea88c8cc0d13db9b20/users/18adf7fcfdc54cb38906e74791be9745/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:29.458381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b14823e48048ea88c8cc0d13db9b20, user_id=18adf7fcfdc54cb38906e74791be9745, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:29.461196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.545312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1276/2587] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:29 2022] PUT /identity/v3/projects/61b14823e48048ea88c8cc0d13db9b20/users/18adf7fcfdc54cb38906e74791be9745/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:29.548999 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:29.561156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79077-193a-45e8-8ed4-85d937b320a5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:29.592122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:29.646294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:29.647106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:29.647466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:29.647837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:29.648573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:29.650304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.665238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1312/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:29.670050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977978a5-151d-4aa1-a62f-10e99703088d admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:29.672056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:29.675061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:29.676351 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:29.676633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:29.676911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] PATH_INFO: `/v3/users/dfacee0a8c5842d082c8e7a0696969c7` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:29.678100 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfacee0a8c5842d082c8e7a0696969c7)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:29.680057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.683355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da826367-1088-45b1-833a-ce70e2e841ff admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:29.688841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63cc38-81fc-4db0-b84b-6d6238f11c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:29.689545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63cc38-81fc-4db0-b84b-6d6238f11c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:29.689841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63cc38-81fc-4db0-b84b-6d6238f11c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:29.690124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63cc38-81fc-4db0-b84b-6d6238f11c34 admin admin] PATH_INFO: `/v3/projects/61b14823e48048ea88c8cc0d13db9b20/users/18adf7fcfdc54cb38906e74791be9745/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:29.693483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63cc38-81fc-4db0-b84b-6d6238f11c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b14823e48048ea88c8cc0d13db9b20, user_id=18adf7fcfdc54cb38906e74791be9745, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:29.696181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63cc38-81fc-4db0-b84b-6d6238f11c34 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:29.707859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1313/2589] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:29 2022] PUT /identity/v3/projects/61b14823e48048ea88c8cc0d13db9b20/users/18adf7fcfdc54cb38906e74791be9745/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:29.895406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfacee0a8c5842d082c8e7a0696969c7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:29.903912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfacee0a8c5842d082c8e7a0696969c7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:29.905001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfacee0a8c5842d082c8e7a0696969c7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:29.905749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfacee0a8c5842d082c8e7a0696969c7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:29.990719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfacee0a8c5842d082c8e7a0696969c7'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:30.002222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:30.011178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1277/2590] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:29 2022] DELETE /identity/v3/users/dfacee0a8c5842d082c8e7a0696969c7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:30.015841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:30.016312 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:30.016607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:30.037805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:30.042775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:30.076764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:30.128728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1314/2591] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:21:30.132226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:30.134113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:30.196327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c9a9-249d-44ea-b3b9-d1a34b36ede8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:30.199983 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:30.204602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:30.204602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:30.204602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:30.212303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:30.213842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:30.225650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1278/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:30.754148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:30.757286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:30.772502 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6eaa-5cd1-459f-b10c-047cd464eecf None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:30.778463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:30.779115 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:30.779760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:30.779760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] PATH_INFO: `/v3/projects/1b56a8fa609a4399be5ca2da2efab38b` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:30.781215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b56a8fa609a4399be5ca2da2efab38b)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:30.790338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:30.933851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b56a8fa609a4399be5ca2da2efab38b', 'request_id': 'req-5b6cee7e-da33-478a-b31b-7f8af987cc67'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:30.995003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b56a8fa609a4399be5ca2da2efab38b', 'request_id': 'req-5b6cee7e-da33-478a-b31b-7f8af987cc67'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.001810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b56a8fa609a4399be5ca2da2efab38b', 'request_id': 'req-5b6cee7e-da33-478a-b31b-7f8af987cc67'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.012542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] The token cache is being invalidate because project 1b56a8fa609a4399be5ca2da2efab38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:31.012841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.013544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.015026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1315/2593] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:30 2022] DELETE /identity/v3/projects/1b56a8fa609a4399be5ca2da2efab38b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:31.019039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:31.029462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b801c7-5955-494d-90e1-fff124a6cb3a service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:31.093344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:31.093921 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:31.094208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:31.094491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] PATH_INFO: `/v3/users/48366fcebf7c4fb9bea655f4c8983ee0` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:31.095695 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=48366fcebf7c4fb9bea655f4c8983ee0)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:31.098537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:31.319494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48366fcebf7c4fb9bea655f4c8983ee0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.330882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48366fcebf7c4fb9bea655f4c8983ee0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.336787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48366fcebf7c4fb9bea655f4c8983ee0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.339865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48366fcebf7c4fb9bea655f4c8983ee0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.423258 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-2548d182-5441-4940-af1b-378ef770e2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48366fcebf7c4fb9bea655f4c8983ee0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:31.450262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1279/2594] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:31 2022] DELETE /identity/v3/users/48366fcebf7c4fb9bea655f4c8983ee0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:32.174425 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:32.179202 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:32.231824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cee7e-da33-478a-b31b-7f8af987cc67 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:32.343783 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:32.345721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:32.345721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:32.345721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] PATH_INFO: `/v3/projects/38296d6411494818b20a6ccf1f8ca9b4` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:32.346726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38296d6411494818b20a6ccf1f8ca9b4)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:32.350007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:32.529682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38296d6411494818b20a6ccf1f8ca9b4', 'request_id': 'req-e9b9695d-1942-4029-8f11-1d2417c0d903'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:32.595061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38296d6411494818b20a6ccf1f8ca9b4', 'request_id': 'req-e9b9695d-1942-4029-8f11-1d2417c0d903'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:32.599196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:32.604192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38296d6411494818b20a6ccf1f8ca9b4', 'request_id': 'req-e9b9695d-1942-4029-8f11-1d2417c0d903'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:32.620969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] The token cache is being invalidate because project 38296d6411494818b20a6ccf1f8ca9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:32.621719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:32.623123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e9b9695d-1942-4029-8f11-1d2417c0d903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:32.624539 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1316/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:32 2022] DELETE /identity/v3/projects/38296d6411494818b20a6ccf1f8ca9b4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:32.630404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:32.630945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:32.631116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:32.657627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:32.657627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:32.665526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:32.732972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1280/2596] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:32.740012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:32.749511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:32.749511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:32.768974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:32.768974 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:32.774240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1317/2597] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:32.778687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:32.789716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edff74-1f22-40b9-acf7-8e2be1315c7f None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:32.794568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:32.795195 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:32.795503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:32.795752 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:32.796407 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:32.796713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:32.798349 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:32.812600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1281/2598] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:21:32.817907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:32.827880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5401ff-fa6e-4c33-ae7e-e9628a0f4270 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:32.837789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:32.837789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:32.837789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:32.837789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:32.838180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:32.838575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:32.968466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1318/2599] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:32 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:32.973554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:33.001654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71b0e-3cec-427c-ad2c-4ee2fd67762a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:33.132715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:33.135571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.135571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.135571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.135571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:33.136497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:33.235575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1282/2600] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:32 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:33.240072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:33.251674 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5feee-1ccb-460f-8fab-9136d5dd07a9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:33.257958 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:33.258590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.258874 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.259151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.260078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:33.261963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:33.276852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1319/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:21:33.280719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:33.294229 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456204-58dd-48b5-b212-497da1c29cf3 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:33.301271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cc8ae-92d8-40de-9f03-4f91e9608425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:33.302249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cc8ae-92d8-40de-9f03-4f91e9608425 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.302786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cc8ae-92d8-40de-9f03-4f91e9608425 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.303420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cc8ae-92d8-40de-9f03-4f91e9608425 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.304386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cc8ae-92d8-40de-9f03-4f91e9608425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:33.307723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cc8ae-92d8-40de-9f03-4f91e9608425 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:33.320909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1283/2602] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:33.325197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:33.338154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270853-3577-4e27-8627-6bbff5ab2aba admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:33.343857 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:33.355409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.355409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.355409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] PATH_INFO: `/v3/projects/fad5e9b47fea4e5f87d422ab30c89113/users/43a3cc704e944cce9aeb26bed40d796f/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.372568 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad5e9b47fea4e5f87d422ab30c89113, user_id=43a3cc704e944cce9aeb26bed40d796f, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:33.378191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:33.501827 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1320/2603] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:33 2022] PUT /identity/v3/projects/fad5e9b47fea4e5f87d422ab30c89113/users/43a3cc704e944cce9aeb26bed40d796f/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:21:33.524069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.524379 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.524664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.587697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] MFA Rules not processed for user `43a3cc704e944cce9aeb26bed40d796f`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:33.593722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:33.754558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1284/2604] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:33.766595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:33.768548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:33.887624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b251b-6b4e-46e1-8639-08b10089f1f6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:33.892372 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc8e7-c4cf-4cb7-88e5-33e35df014bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:33.893415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc8e7-c4cf-4cb7-88e5-33e35df014bf service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.894180 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc8e7-c4cf-4cb7-88e5-33e35df014bf service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.895223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc8e7-c4cf-4cb7-88e5-33e35df014bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.906000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc8e7-c4cf-4cb7-88e5-33e35df014bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:33.908162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc8e7-c4cf-4cb7-88e5-33e35df014bf service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:33.924797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1321/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:33.948985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:33.964523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:34.039286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10002ec7-a0c2-4ccd-9a16-7bce5c63dbdd None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:34.044813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:34.045559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:34.045918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:34.046274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] PATH_INFO: `/v3/users/43a3cc704e944cce9aeb26bed40d796f` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:34.047780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a3cc704e944cce9aeb26bed40d796f)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:34.051991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:34.266144 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a3cc704e944cce9aeb26bed40d796f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:34.277754 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a3cc704e944cce9aeb26bed40d796f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:34.280212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a3cc704e944cce9aeb26bed40d796f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:34.280777 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a3cc704e944cce9aeb26bed40d796f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:34.372396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a3cc704e944cce9aeb26bed40d796f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:34.400747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1285/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:21:33 2022] DELETE /identity/v3/users/43a3cc704e944cce9aeb26bed40d796f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:34.402663 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:34.415149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:34.415149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:34.435705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:34.436950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:34.553389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1322/2607] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:34.560358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:34.562070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:34.648984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0816d2-629d-43bd-917c-65e04a526bb1 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:34.653421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008e9fc-a66d-4785-b5f3-80b8af211b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:34.658814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008e9fc-a66d-4785-b5f3-80b8af211b60 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:34.658814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008e9fc-a66d-4785-b5f3-80b8af211b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:34.658814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008e9fc-a66d-4785-b5f3-80b8af211b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:34.665987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008e9fc-a66d-4785-b5f3-80b8af211b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:34.667528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008e9fc-a66d-4785-b5f3-80b8af211b60 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:34.680966 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1286/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:35.210381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:35.217431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:35.240349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285830e-129a-4575-822c-4f91adefa5ea None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:35.255059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:35.256897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:35.257593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:35.258556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] PATH_INFO: `/v3/projects/fad5e9b47fea4e5f87d422ab30c89113` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:35.260274 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad5e9b47fea4e5f87d422ab30c89113)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:35.263410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:35.327340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:35.445514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad5e9b47fea4e5f87d422ab30c89113', 'request_id': 'req-b796d4d4-6ef5-4576-a115-51c48b242c32'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:35.618952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad5e9b47fea4e5f87d422ab30c89113', 'request_id': 'req-b796d4d4-6ef5-4576-a115-51c48b242c32'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:35.629216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad5e9b47fea4e5f87d422ab30c89113', 'request_id': 'req-b796d4d4-6ef5-4576-a115-51c48b242c32'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:35.642369 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] The token cache is being invalidate because project fad5e9b47fea4e5f87d422ab30c89113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:21:35.642871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:35.643855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-b796d4d4-6ef5-4576-a115-51c48b242c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:21:35.655796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1323/2609] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:21:35 2022] DELETE /identity/v3/projects/fad5e9b47fea4e5f87d422ab30c89113 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:35.662664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:35.663501 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:35.664108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:35.687866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:35.691834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:35.739157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:35.782723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1287/2610] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:35.791665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:35.792342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:35.792810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:35.827411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:35.829407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:35.842873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1324/2611] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:35.847822 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:35.862000 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654f97-69ef-4a15-9064-4e6228f41fae None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:35.868086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:35.871341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:35.871341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:35.871341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:35.871341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:21:35.871341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:35.872475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:35.885428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1288/2612] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:21:35.889902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:35.901880 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b2096-f722-4bf0-9308-c0004b8688b5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:35.908908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:35.910405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:35.910688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:35.910963 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:35.911611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:35.913624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:36.017573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1325/2613] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:21:35 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:36.019080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.031781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a90d5-20a6-4b75-b2aa-8c229f9a17f5 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:36.142561 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:36.144694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.144694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.145579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.164075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:36.170491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:36.268744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1289/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:21:36 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:21:36.270732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.288548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdda6e-12c2-47d2-bed5-101f77044f60 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:36.303258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:36.303977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.304271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.304543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.305444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:36.308708 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:36.328882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1326/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:21:36.334061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.357887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc752-1adc-499f-812b-e56d537a147f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:36.379666 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11b71-e971-4a22-bd9a-46e134d34a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:36.380298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11b71-e971-4a22-bd9a-46e134d34a26 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.380583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11b71-e971-4a22-bd9a-46e134d34a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.380963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11b71-e971-4a22-bd9a-46e134d34a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.381617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be11b71-e971-4a22-bd9a-46e134d34a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:36.383242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be11b71-e971-4a22-bd9a-46e134d34a26 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:36.403526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1290/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:21:36.405228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.425753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791f9df-67d3-4ae2-8d8d-d961858e3da7 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:36.434785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7df6d-17a9-49ef-b492-0b30bf7859dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:36.435488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7df6d-17a9-49ef-b492-0b30bf7859dd admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.435823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7df6d-17a9-49ef-b492-0b30bf7859dd admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.436694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7df6d-17a9-49ef-b492-0b30bf7859dd admin admin] PATH_INFO: `/v3/projects/15b446413ab14503a4ed77f471af9ff0/users/6b8319d41e11473fba7355f61fee847a/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.460723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7df6d-17a9-49ef-b492-0b30bf7859dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b446413ab14503a4ed77f471af9ff0, user_id=6b8319d41e11473fba7355f61fee847a, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:36.463524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7df6d-17a9-49ef-b492-0b30bf7859dd admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:36.552862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1327/2617] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:21:36 2022] PUT /identity/v3/projects/15b446413ab14503a4ed77f471af9ff0/users/6b8319d41e11473fba7355f61fee847a/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:21:36.563093 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.564685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.567686 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.614340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] MFA Rules not processed for user `6b8319d41e11473fba7355f61fee847a`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:36.615874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:36.627775 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.629045 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.629531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.710270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] MFA Rules not processed for user `18adf7fcfdc54cb38906e74791be9745`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:36.711751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:36.755150 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1291/2618] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:36.763861 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.765559 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:36.823537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:36.847854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1328/2619] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:36.859984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10168bd1-25f2-46d6-9c5e-6c1798bde0a9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:36.861462 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.862983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:36.865244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8b34-0834-474e-87ae-250018b014db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:36.865974 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8b34-0834-474e-87ae-250018b014db service glance] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.866324 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8b34-0834-474e-87ae-250018b014db service glance] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.866672 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8b34-0834-474e-87ae-250018b014db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.877199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8b34-0834-474e-87ae-250018b014db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:36.879481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8b34-0834-474e-87ae-250018b014db service glance] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:36.895874 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1292/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:36.914672 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:36.964542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e2920-882b-48d9-9163-a36aa1504129 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:36.970951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:36.971576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.971861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.972151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.974751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:37.070484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:37.072304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca72e8-edec-446b-969e-d7384521e6ad service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:37.085814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1329/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:39.985422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31529-c7ba-4676-8d20-1e1d4d0715cd None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:39.985970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31529-c7ba-4676-8d20-1e1d4d0715cd None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:39.986206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31529-c7ba-4676-8d20-1e1d4d0715cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:40.009730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-e6a31529-c7ba-4676-8d20-1e1d4d0715cd None None] MFA Rules not processed for user `6b90f274167943498168b681f173a7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:40.016060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e6a31529-c7ba-4676-8d20-1e1d4d0715cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:40.021626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1293/2622] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:47.207921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=42 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:48.008088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:48.008495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:48.008884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:48.030411 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] MFA Rules not processed for user `e5014c331aa04771ac313ffbd2ea19b9`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:48.032073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:48.095560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1330/2623] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:50.003079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=16 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:55.318491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:55.319090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:55.319090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:55.339980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:55.341239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:55.413935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1294/2624] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:55.564695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:55.567054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:55.681593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10d039-d145-44f8-be24-fbbfa01c958e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:55.689439 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b25351-5d7b-4805-a3d6-5885dccdab29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:55.690092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25351-5d7b-4805-a3d6-5885dccdab29 service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:55.690423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25351-5d7b-4805-a3d6-5885dccdab29 service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:55.690697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b25351-5d7b-4805-a3d6-5885dccdab29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:55.706153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25351-5d7b-4805-a3d6-5885dccdab29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:55.706153 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b25351-5d7b-4805-a3d6-5885dccdab29 service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:55.715429 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1331/2625] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:05.367085 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:05.589940 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e911c9-3d12-401b-a1bd-b19fc31508b4 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:05.595969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:05.600794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:05.600794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:05.600794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] PATH_INFO: `/v3/users/6b8319d41e11473fba7355f61fee847a` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:05.600794 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8319d41e11473fba7355f61fee847a)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:05.601348 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:05.711570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=57 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:05.788326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8319d41e11473fba7355f61fee847a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:05.797459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8319d41e11473fba7355f61fee847a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:05.798430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8319d41e11473fba7355f61fee847a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:05.799078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8319d41e11473fba7355f61fee847a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:05.846545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8319d41e11473fba7355f61fee847a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:05.849573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:05.873866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1295/2626] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:22:05 2022] DELETE /identity/v3/users/6b8319d41e11473fba7355f61fee847a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:22:05.879852 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:05.880017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:05.880199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:05.946215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:05.947618 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:06.025892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1332/2627] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:06.036538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:06.037828 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:06.132852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82f3a-8756-4ff0-9501-83c049bcbc0a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:06.136783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bf375-951d-4b5b-9af9-0ed9afab279e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:06.137487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bf375-951d-4b5b-9af9-0ed9afab279e service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:06.137788 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bf375-951d-4b5b-9af9-0ed9afab279e service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:06.138087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bf375-951d-4b5b-9af9-0ed9afab279e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:06.148415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bf375-951d-4b5b-9af9-0ed9afab279e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:06.149775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bf375-951d-4b5b-9af9-0ed9afab279e service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:06.161300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1296/2628] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:22:06.671776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:06.673286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:06.709342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1c71-6940-41be-9d29-37bd68d2b3d8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:06.715622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:06.716414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:06.716814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:06.717313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] PATH_INFO: `/v3/projects/15b446413ab14503a4ed77f471af9ff0` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:06.718707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b446413ab14503a4ed77f471af9ff0)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:06.721542 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:06.878206 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b446413ab14503a4ed77f471af9ff0', 'request_id': 'req-d4ebc988-5031-4949-97e6-26ab6aa3918a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:06.961129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b446413ab14503a4ed77f471af9ff0', 'request_id': 'req-d4ebc988-5031-4949-97e6-26ab6aa3918a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:06.971302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b446413ab14503a4ed77f471af9ff0', 'request_id': 'req-d4ebc988-5031-4949-97e6-26ab6aa3918a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:06.995818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] The token cache is being invalidate because project 15b446413ab14503a4ed77f471af9ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:22:06.996508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:06.997705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d4ebc988-5031-4949-97e6-26ab6aa3918a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:06.999765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1333/2629] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:22:06 2022] DELETE /identity/v3/projects/15b446413ab14503a4ed77f471af9ff0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:22:07.004413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.005818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.006356 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.094413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:07.096368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:07.199326 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1297/2630] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:07.207280 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.207575 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.207907 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.270640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:07.275658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:07.292759 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1334/2631] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:07.294504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:07.326217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c2fa-aa72-4fca-88ba-eb14c74fcadc None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:07.331370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:07.332635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.332976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.333357 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.334390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:22:07.334775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:07.336783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:07.350979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1298/2632] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:22:07.358308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:07.368414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b271de-67d4-497e-8355-e39d016e6e11 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:07.373778 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:07.374650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.374938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.375224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.375868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:07.379492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:07.505765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1335/2633] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:22:07 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:22:07.525146 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:07.537273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ad531-87a6-488c-aefd-80f14a1f486c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:07.596782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:07.643010 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:07.644065 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.644834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.645313 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.646439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:07.648541 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:07.813282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1299/2634] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:22:07 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:22:07.819354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:07.827074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3279d4-56bb-4c10-a508-6165fbb54358 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:07.838244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:07.839713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.840408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.840903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.841968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:07.844419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:07.880391 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1336/2635] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:22:07.884577 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:07.922583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728f6c7-3c7a-4ac7-b447-f06e2de00828 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:07.934370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ef46-fafe-454e-be9c-eb8b37dc8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:07.935001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ef46-fafe-454e-be9c-eb8b37dc8214 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.935367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ef46-fafe-454e-be9c-eb8b37dc8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.935659 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ef46-fafe-454e-be9c-eb8b37dc8214 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.936412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ef46-fafe-454e-be9c-eb8b37dc8214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:07.937958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ef46-fafe-454e-be9c-eb8b37dc8214 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:07.972168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1300/2636] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:22:07.974693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:07.992595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee3165-ba9e-498a-9c00-fd2391cde759 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:08.001222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:08.002417 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:08.002942 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:08.003836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] PATH_INFO: `/v3/projects/6777f9eb21d64cbf8c101c3ffb4a60c6/users/928ef48e85734fed8db1ca9062df4d58/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:08.049067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6777f9eb21d64cbf8c101c3ffb4a60c6, user_id=928ef48e85734fed8db1ca9062df4d58, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:08.053773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:08.061979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:08.173175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1337/2637] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:22:07 2022] PUT /identity/v3/projects/6777f9eb21d64cbf8c101c3ffb4a60c6/users/928ef48e85734fed8db1ca9062df4d58/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:22:08.184188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:08.185338 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:08.185907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:08.276333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] MFA Rules not processed for user `928ef48e85734fed8db1ca9062df4d58`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:08.279953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:08.367605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1301/2638] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:08.381107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:08.383179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:08.542342 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611bfce-b45d-47f9-aacd-241e1732b6ac admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:08.550756 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:08.551872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:08.552074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:08.552365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:08.573175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:08.574682 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:08.592350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1338/2639] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:10.202287 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:10.203809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:10.317819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d7b21-a4a1-4419-8642-070c3547ed4a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:10.324246 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:10.328073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:10.328073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:10.328073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:10.328073 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:10.340967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:10.342901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7ae4a-1ab6-4631-be77-ba1e6cac67b0 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:10.356507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1302/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:14.694486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:14.760806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d6a23-2a08-4620-899d-07255dc6c2d1 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:14.765374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:14.766006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:14.766289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:14.766564 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] PATH_INFO: `/v3/users/928ef48e85734fed8db1ca9062df4d58` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:14.767685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928ef48e85734fed8db1ca9062df4d58)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:14.770143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:15.071735 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928ef48e85734fed8db1ca9062df4d58'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:15.072309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928ef48e85734fed8db1ca9062df4d58'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:15.079220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928ef48e85734fed8db1ca9062df4d58'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:15.166025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928ef48e85734fed8db1ca9062df4d58'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:15.179503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928ef48e85734fed8db1ca9062df4d58'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:15.185466 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1339/2641] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:22:14 2022] DELETE /identity/v3/users/928ef48e85734fed8db1ca9062df4d58 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:22:15.189969 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:15.190445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:15.191107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:15.210888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:15.212090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:15.217836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:15.275417 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1303/2642] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:22:15.285885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:15.287276 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:15.306698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:15.347427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91de6-6e91-4e53-9f0e-6be200837f27 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:15.351424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c394d7-2221-4247-be7e-54bcc93c05ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:15.352093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c394d7-2221-4247-be7e-54bcc93c05ee service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:15.352382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c394d7-2221-4247-be7e-54bcc93c05ee service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:15.352659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c394d7-2221-4247-be7e-54bcc93c05ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:15.363088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c394d7-2221-4247-be7e-54bcc93c05ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:15.364587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c394d7-2221-4247-be7e-54bcc93c05ee service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:15.374302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1340/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:22:15.833157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:15.836971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:15.855096 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a24a-b7e6-478d-afda-8a088b50a065 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:15.861987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:15.862985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:15.863454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:15.863942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] PATH_INFO: `/v3/projects/6777f9eb21d64cbf8c101c3ffb4a60c6` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:15.866645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6777f9eb21d64cbf8c101c3ffb4a60c6)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:15.871664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:16.013505 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6777f9eb21d64cbf8c101c3ffb4a60c6', 'request_id': 'req-74754dc1-8e0d-4778-8e48-97064e40f547'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:16.023140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6777f9eb21d64cbf8c101c3ffb4a60c6', 'request_id': 'req-74754dc1-8e0d-4778-8e48-97064e40f547'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:16.035370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6777f9eb21d64cbf8c101c3ffb4a60c6', 'request_id': 'req-74754dc1-8e0d-4778-8e48-97064e40f547'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:16.117704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] The token cache is being invalidate because project 6777f9eb21d64cbf8c101c3ffb4a60c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:22:16.117948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:16.118628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-74754dc1-8e0d-4778-8e48-97064e40f547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:22:16.122368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1304/2644] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:22:15 2022] DELETE /identity/v3/projects/6777f9eb21d64cbf8c101c3ffb4a60c6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:22:19.196910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363786d-7b65-4078-8336-81c0ec87db51 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.197454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363786d-7b65-4078-8336-81c0ec87db51 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.197565 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363786d-7b65-4078-8336-81c0ec87db51 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.198831 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1341/2645] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:19.204823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9726-3158-4ac2-b057-ee413873bde7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.205285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9726-3158-4ac2-b057-ee413873bde7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.205568 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9726-3158-4ac2-b057-ee413873bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.254293 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-28aa9726-3158-4ac2-b057-ee413873bde7 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:19.255650 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-28aa9726-3158-4ac2-b057-ee413873bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.327062 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:19.352289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1305/2646] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:19.360651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363786d-7b65-4078-8336-81c0ec87db51 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:19.363104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-3363786d-7b65-4078-8336-81c0ec87db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.421925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363786d-7b65-4078-8336-81c0ec87db51 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:19.426189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f28fa-2a4d-421a-bbd3-61569d983f0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:19.426797 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f28fa-2a4d-421a-bbd3-61569d983f0b service glance] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.427078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f28fa-2a4d-421a-bbd3-61569d983f0b service glance] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.427359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f28fa-2a4d-421a-bbd3-61569d983f0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.437494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f28fa-2a4d-421a-bbd3-61569d983f0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:19.438924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f28fa-2a4d-421a-bbd3-61569d983f0b service glance] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:19.454928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1342/2647] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:19.670916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933d78a-1c8a-42ea-b322-09b53bd41c1e None None] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.671134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933d78a-1c8a-42ea-b322-09b53bd41c1e None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.671444 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933d78a-1c8a-42ea-b322-09b53bd41c1e None None] PATH_INFO: `/` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.672826 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1306/2648] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:19.678450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809526-b1a6-40d0-94e9-dfeecc31605a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.678741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809526-b1a6-40d0-94e9-dfeecc31605a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.679022 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809526-b1a6-40d0-94e9-dfeecc31605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.710381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-19809526-b1a6-40d0-94e9-dfeecc31605a None None] MFA Rules not processed for user `36a39e19ba8648ceb28c67d22c00e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:19.711668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-19809526-b1a6-40d0-94e9-dfeecc31605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.775237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1343/2649] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:19.787915 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933d78a-1c8a-42ea-b322-09b53bd41c1e None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:19.789842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f933d78a-1c8a-42ea-b322-09b53bd41c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.803312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933d78a-1c8a-42ea-b322-09b53bd41c1e None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:19.807442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8163b-69cf-4ab8-8b51-37c7161f90e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:19.808049 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8163b-69cf-4ab8-8b51-37c7161f90e3 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.808331 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8163b-69cf-4ab8-8b51-37c7161f90e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.808611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8163b-69cf-4ab8-8b51-37c7161f90e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.816530 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8163b-69cf-4ab8-8b51-37c7161f90e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:19.818030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8163b-69cf-4ab8-8b51-37c7161f90e3 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:19.826244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1307/2650] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:19.914116 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167967b3-ebfe-4666-b6a7-24d3f916f5b6 None None] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.914433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167967b3-ebfe-4666-b6a7-24d3f916f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.914721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167967b3-ebfe-4666-b6a7-24d3f916f5b6 None None] PATH_INFO: `/` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.916057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1344/2651] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 30 01:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:19.924184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c63e-fc5f-4bce-af35-018985992945 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.924184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c63e-fc5f-4bce-af35-018985992945 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.924184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c63e-fc5f-4bce-af35-018985992945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.942778 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d977c63e-fc5f-4bce-af35-018985992945 None None] MFA Rules not processed for user `e3083107d17b4596b7b858df7fc50147`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:19.944134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d977c63e-fc5f-4bce-af35-018985992945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.953862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1308/2652] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 30 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:19.965311 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167967b3-ebfe-4666-b6a7-24d3f916f5b6 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:19.967063 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-167967b3-ebfe-4666-b6a7-24d3f916f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.983007 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167967b3-ebfe-4666-b6a7-24d3f916f5b6 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:19.986855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:19.987528 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.987819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.988234 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:20.000514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:20.002091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:20.014566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1345/2653] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:22.843629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:22.844119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:22.844230 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:22.864925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:22.866178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:22.934856 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1309/2654] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 30 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:22.946813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:22.948559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:22.994235 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=100 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:23.034198 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a102-5ed8-47b8-b73d-895e0d3bf284 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:23.042665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670facb8-87eb-415b-95ea-159c6b47f7ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:23.043320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670facb8-87eb-415b-95ea-159c6b47f7ca service swift] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:23.043611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670facb8-87eb-415b-95ea-159c6b47f7ca service swift] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:23.043890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670facb8-87eb-415b-95ea-159c6b47f7ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:23.052748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670facb8-87eb-415b-95ea-159c6b47f7ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:23.054393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670facb8-87eb-415b-95ea-159c6b47f7ca service swift] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:23.062924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1346/2655] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:32.928200 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=38 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:33.059722 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=15 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:37.477318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:37.486917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb1f64-2641-4f20-bc81-9cdd9d032559 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:37.491321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:37.491931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:37.492218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:37.492500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:37.494286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:37.560222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:37.561729 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:37.571807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1310/2656] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:42.439071 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:42.439833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:42.439935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:42.460197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] MFA Rules not processed for user `7236db7932e2438db1c71d596d1e17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:42.461365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:42.468624 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1347/2657] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 30 01:22:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:42.481442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:42.492960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57664a7-c44e-4529-b596-0e1f22afcc87 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:42.498027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d48d9e6668b4866a21c2e0361fd3b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:42.498656 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:42.498939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:42.499241 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:42.508865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:42.510527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:42.520370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1311/2658] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 30 01:22:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:52.453990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:52.515884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=36 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:54.299295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:54.310042 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984774d4-70f3-4b18-9cdf-a9660c749960 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:54.313604 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:54.314826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:54.315106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:54.315636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:54.317405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:54.380380 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:54.381856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:54.391335 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1348/2659] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:58.150468 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:58.160893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0c0dc-c544-4903-a2ee-0d8a997d6e54 service swift] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:58.164748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:58.165387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:58.165667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:58.165942 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:58.167774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:58.182897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:58.182897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:58.191928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1312/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:58.235595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:58.237355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:58.251395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93b62-f622-44c5-a9ff-1d12ceb42e36 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:58.260986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:58.262112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:58.262630 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:58.263072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] PATH_INFO: `/v3/users/e5014c331aa04771ac313ffbd2ea19b9` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:58.264433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5014c331aa04771ac313ffbd2ea19b9)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:58.266603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:58.449181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5014c331aa04771ac313ffbd2ea19b9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:58.449913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5014c331aa04771ac313ffbd2ea19b9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:58.458590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5014c331aa04771ac313ffbd2ea19b9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:58.537721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5014c331aa04771ac313ffbd2ea19b9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:58.551937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c0a5b447-492b-4083-8f16-5e6c9a22d4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5014c331aa04771ac313ffbd2ea19b9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:58.558016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1349/2661] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:23:58 2022] DELETE /identity/v3/users/e5014c331aa04771ac313ffbd2ea19b9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:23:58.851815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:58.865276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810669c-5445-47f8-a16d-0d37892a6562 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:58.934064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:58.934704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:58.934991 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:58.935274 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] PATH_INFO: `/v3/projects/fa97c815ed7241968ed773a1442cd2b2` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:58.948276 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa97c815ed7241968ed773a1442cd2b2)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:58.950245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.069975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa97c815ed7241968ed773a1442cd2b2', 'request_id': 'req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:59.076592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa97c815ed7241968ed773a1442cd2b2', 'request_id': 'req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:59.082252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa97c815ed7241968ed773a1442cd2b2', 'request_id': 'req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:59.160871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] The token cache is being invalidate because project fa97c815ed7241968ed773a1442cd2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:23:59.161545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:59.162282 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8c0f10f-a656-44b9-a014-6b7d5493fa2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:23:59.163455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1313/2662] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:23:58 2022] DELETE /identity/v3/projects/fa97c815ed7241968ed773a1442cd2b2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:23:59.169165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.169483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.170017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.194031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:59.195260 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:59.266754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1350/2663] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:59.276473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.276837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.277214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.301308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:59.303235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:59.311199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1314/2664] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:59.317360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:59.330532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ab453-9c8a-4bc5-804d-b26ff3db9c65 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:59.336903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:59.337652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.338037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.338412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.339182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:23:59.339585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:59.341431 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.343353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:59.357378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1351/2665] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:23:59.362184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:59.372341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23b94-aa8e-4102-8d44-82f25abcf4d3 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:59.378026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:59.379248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.379604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.379950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.380693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:59.382811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.481041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1315/2666] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:23:59 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:23:59.482523 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:59.493384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a529cc3-6199-4050-b5cb-524c7db54bbe admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:59.575322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:59.575962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.576245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.576518 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.577444 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:59.579489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.651821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1352/2667] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:23:59 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:23:59.655734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:59.676051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67888a-9e19-46d3-b83a-423d5a7bdf70 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:59.683377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:59.684001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.684277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.684640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.685342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:59.686963 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.701896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1316/2668] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:23:59.703587 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:59.721892 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49400b7f-5e24-4d94-924d-5cdb568d4c51 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:59.729754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2af03-f74b-4ca1-8d31-b87bd9aafcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:59.730753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2af03-f74b-4ca1-8d31-b87bd9aafcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.732126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2af03-f74b-4ca1-8d31-b87bd9aafcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.732878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2af03-f74b-4ca1-8d31-b87bd9aafcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.734611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2af03-f74b-4ca1-8d31-b87bd9aafcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:59.740341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2af03-f74b-4ca1-8d31-b87bd9aafcd9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.762825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1353/2669] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:23:59.769566 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:59.781217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8dd8b-f7c4-4002-8050-7adfdaf67c13 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:59.787889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:59.788578 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.788863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.789188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] PATH_INFO: `/v3/projects/72122b17d5434cdc8571f8350b98f307/users/d7167e7dd84441ebb43078dce020279e/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.808052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72122b17d5434cdc8571f8350b98f307, user_id=d7167e7dd84441ebb43078dce020279e, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:59.810880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:59.815995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:59.918361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1317/2670] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:23:59 2022] PUT /identity/v3/projects/72122b17d5434cdc8571f8350b98f307/users/d7167e7dd84441ebb43078dce020279e/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:23:59.934734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:59.935173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:59.935553 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:59.968977 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] MFA Rules not processed for user `d7167e7dd84441ebb43078dce020279e`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:59.970858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:00.041474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1354/2671] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:00.053819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:00.055769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:00.141269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cd944-2714-49e5-8270-cafd0bda6923 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:00.149164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5911036-f0a8-4e36-8152-8872aa346079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:00.149919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911036-f0a8-4e36-8152-8872aa346079 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:00.150298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911036-f0a8-4e36-8152-8872aa346079 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:00.150674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5911036-f0a8-4e36-8152-8872aa346079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:00.160376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5911036-f0a8-4e36-8152-8872aa346079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:00.162245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5911036-f0a8-4e36-8152-8872aa346079 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:00.175544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1318/2672] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:00.444294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:00.519093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f792ed0-7a4b-48c1-a999-ff0a331783d1 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:00.523867 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:00.524511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:00.524796 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:00.525105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] PATH_INFO: `/v3/users/d7167e7dd84441ebb43078dce020279e` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:00.526278 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7167e7dd84441ebb43078dce020279e)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:00.528211 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:00.531475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:00.732748 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7167e7dd84441ebb43078dce020279e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:00.733428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7167e7dd84441ebb43078dce020279e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:00.740517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7167e7dd84441ebb43078dce020279e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:00.803707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7167e7dd84441ebb43078dce020279e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:00.818124 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7167e7dd84441ebb43078dce020279e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:00.824790 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1355/2673] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:24:00 2022] DELETE /identity/v3/users/d7167e7dd84441ebb43078dce020279e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:00.829267 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:00.829553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:00.830605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:00.850683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:00.851893 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:00.916589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1319/2674] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:24:00.926804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:00.928463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:01.001617 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af566bd-e172-4be7-8fbf-230220e77801 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:01.006137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea3fe-2083-495d-b286-228964c71f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:01.007677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea3fe-2083-495d-b286-228964c71f36 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:01.007677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea3fe-2083-495d-b286-228964c71f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:01.007677 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea3fe-2083-495d-b286-228964c71f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:01.018340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dea3fe-2083-495d-b286-228964c71f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:01.020567 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dea3fe-2083-495d-b286-228964c71f36 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:01.035589 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1356/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:01.552912 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:01.554589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:01.569714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbafbba-3d19-42cb-a06e-a014e2fc2f28 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:01.575190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:01.575975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:01.576461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:01.576735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] PATH_INFO: `/v3/projects/72122b17d5434cdc8571f8350b98f307` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:01.578101 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72122b17d5434cdc8571f8350b98f307)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:01.582002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:01.732758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72122b17d5434cdc8571f8350b98f307', 'request_id': 'req-f1220b2b-c41c-4390-b683-66fafa783c95'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:01.745035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72122b17d5434cdc8571f8350b98f307', 'request_id': 'req-f1220b2b-c41c-4390-b683-66fafa783c95'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:01.757169 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72122b17d5434cdc8571f8350b98f307', 'request_id': 'req-f1220b2b-c41c-4390-b683-66fafa783c95'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:01.860892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] The token cache is being invalidate because project 72122b17d5434cdc8571f8350b98f307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:24:01.861314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:01.862040 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:01.863615 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1320/2676] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:24:01 2022] DELETE /identity/v3/projects/72122b17d5434cdc8571f8350b98f307 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:01.868561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e3e2-f2f6-4303-8e28-3afc713c9acc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:01.869106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e3e2-f2f6-4303-8e28-3afc713c9acc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:01.869226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e3e2-f2f6-4303-8e28-3afc713c9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:01.888725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-cec7e3e2-f2f6-4303-8e28-3afc713c9acc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:01.889862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cec7e3e2-f2f6-4303-8e28-3afc713c9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:01.968231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1357/2677] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:01.968423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:01.972865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:01.976236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:01.976531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:01.977047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:01.988836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:01.993308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220b2b-c41c-4390-b683-66fafa783c95 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:01.998548 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:01.998876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:01.999358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:01.999715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.000107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] PATH_INFO: `/v3/users/bb7eabbe33b948e8af562ecc310a2bbb` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.000233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:02.008534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1358/2678] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:02.013001 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.022051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7eabbe33b948e8af562ecc310a2bbb)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.023002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04a5e9-ca81-4569-8af0-b4ca7c2ee64b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.024079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.027719 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.028324 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.028606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.028883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.029596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:24:02.029905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.031595 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.044830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1359/2679] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:24:02.051574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.057924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:02.061906 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102dd3e-5f51-4718-81d6-9ba2b71bd9b1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.067336 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.067940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.068230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.068536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.069237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.071154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.165786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1360/2680] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:24:02 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:24:02.170055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.234696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34564084-ab85-4400-be70-2bb020a7d7b8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.240000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.240622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.240911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.241251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.241924 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.243920 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.246755 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7eabbe33b948e8af562ecc310a2bbb'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:02.254875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7eabbe33b948e8af562ecc310a2bbb'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:02.256001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7eabbe33b948e8af562ecc310a2bbb'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:02.257184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7eabbe33b948e8af562ecc310a2bbb'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:02.354528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7eabbe33b948e8af562ecc310a2bbb'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:02.361083 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1361/2681] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:24:02 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:24:02.366858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.368537 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:02.377911 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1321/2682] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:24:01 2022] DELETE /identity/v3/users/bb7eabbe33b948e8af562ecc310a2bbb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:24:02.382714 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2277d-0f09-4856-80b1-9d1c3755563c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.450508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.451237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.451521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.451810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.452448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.454080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.466744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1362/2683] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:24:02.470793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.481563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54e9f-df38-427c-bb5d-670deb529f43 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.487018 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfefff-2759-4cc9-92bd-23780b4742c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.487845 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfefff-2759-4cc9-92bd-23780b4742c7 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.488673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfefff-2759-4cc9-92bd-23780b4742c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.488673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfefff-2759-4cc9-92bd-23780b4742c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.489619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfefff-2759-4cc9-92bd-23780b4742c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.491734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfefff-2759-4cc9-92bd-23780b4742c7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.503641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1322/2684] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:24:02.507730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.520665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c13a-e137-45e7-ba1d-477a41a92c6a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.525686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.526360 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.526637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.526905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] PATH_INFO: `/v3/projects/c1445a61f5a84f11b4e7e5711da47261/users/3177b8c9cac74432a8be75a02529f265/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.544236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1445a61f5a84f11b4e7e5711da47261, user_id=3177b8c9cac74432a8be75a02529f265, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.547012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.629937 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1363/2685] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:02 2022] PUT /identity/v3/projects/c1445a61f5a84f11b4e7e5711da47261/users/3177b8c9cac74432a8be75a02529f265/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:02.641478 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.642030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.642030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.676889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] MFA Rules not processed for user `3177b8c9cac74432a8be75a02529f265`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:02.676889 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:02.679590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.681729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:02.761971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:02.775222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1323/2686] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:02.779841 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.781548 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669d5c-d59e-4d32-a7d0-d3aad13eecb9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.790329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.791383 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.791642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c90ba-eab4-4642-a9fd-f9380e05ea77 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.791765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.791971 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] PATH_INFO: `/v3/projects/af7cf649edeb4f1e93f42a6a8d962820` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.796603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:02.799057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:02.799057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:02.799057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:02.799057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.800981 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.811395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7cf649edeb4f1e93f42a6a8d962820)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:02.813291 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:02.894266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1324/2687] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:24:02 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:24:02.898693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:02.928011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:02.976612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c153022-de95-4f70-8ecb-b59570a4d9c6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:02.986186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7cf649edeb4f1e93f42a6a8d962820', 'request_id': 'req-561ca2c8-d5a2-48d7-b8fa-6068434410c8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:03.039064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.039064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.039064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.039064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.039619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.039720 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.108728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7cf649edeb4f1e93f42a6a8d962820', 'request_id': 'req-561ca2c8-d5a2-48d7-b8fa-6068434410c8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:03.116496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7cf649edeb4f1e93f42a6a8d962820', 'request_id': 'req-561ca2c8-d5a2-48d7-b8fa-6068434410c8'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:03.127501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] The token cache is being invalidate because project af7cf649edeb4f1e93f42a6a8d962820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:24:03.127832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:03.128494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-561ca2c8-d5a2-48d7-b8fa-6068434410c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:03.130072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1364/2688] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:24:02 2022] DELETE /identity/v3/projects/af7cf649edeb4f1e93f42a6a8d962820 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:24:03.134736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587661e-a44e-4fc6-b511-8b6be128701d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.135030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587661e-a44e-4fc6-b511-8b6be128701d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.135314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587661e-a44e-4fc6-b511-8b6be128701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.143979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1325/2689] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:24:02 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:24:03.147937 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.149771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.159120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a587661e-a44e-4fc6-b511-8b6be128701d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:03.160316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a587661e-a44e-4fc6-b511-8b6be128701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.161549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139bfcc-75dd-4499-90c2-742ce048d970 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.166602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.167212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.167633 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.167763 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.168412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.168850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1365/2690] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:24:03.170301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.177621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.177903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.178182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.181768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1326/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:24:03.185761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.196850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0408346-6185-4a1f-9a5e-2df83ee64910 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.198914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:03.200106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.201648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.202321 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.202603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.202881 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] PATH_INFO: `/v3/projects/c4da532047d545828f9d3b2cc2d82107/users/a63ed9805a45496b870e96cfb17f0d4b/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.209450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1366/2692] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:03.213903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.220736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da532047d545828f9d3b2cc2d82107, user_id=a63ed9805a45496b870e96cfb17f0d4b, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.222528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.223506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7bea4-a3b4-40b9-ab3e-b34676188efc None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.228226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.228821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.229139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.229415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.230059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:24:03.230362 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.231938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.244777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1367/2693] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:24:03.249247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.259544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c298d4-a574-417e-b3b1-a8d62d371e2a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.264136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.264713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.265031 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.265313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.265935 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.268111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.308780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1327/2694] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:03 2022] PUT /identity/v3/projects/c4da532047d545828f9d3b2cc2d82107/users/a63ed9805a45496b870e96cfb17f0d4b/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:24:03.312701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.371088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1368/2695] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:24:03 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:24:03.375003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8cf2f-9fda-4835-a7b9-468e192e8ee6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.375225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.409063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:03.440785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4e0b-7cda-4272-bf89-b87f11f7f09a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.441982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.442599 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.442901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.443210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.443853 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.445701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.446024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.446642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.446933 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.447219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.447861 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.449884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.457052 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1328/2696] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:24:03.461451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.471965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21e01a-7cdd-43db-80d5-553145ce9be0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.477041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97458c-34d4-42ae-a015-9d155d524423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.477742 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97458c-34d4-42ae-a015-9d155d524423 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.478023 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97458c-34d4-42ae-a015-9d155d524423 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.478300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97458c-34d4-42ae-a015-9d155d524423 admin admin] PATH_INFO: `/v3/projects/c4da532047d545828f9d3b2cc2d82107/users/a63ed9805a45496b870e96cfb17f0d4b/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.480211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97458c-34d4-42ae-a015-9d155d524423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da532047d545828f9d3b2cc2d82107, user_id=a63ed9805a45496b870e96cfb17f0d4b, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.482865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97458c-34d4-42ae-a015-9d155d524423 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.493838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1329/2697] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:03 2022] PUT /identity/v3/projects/c4da532047d545828f9d3b2cc2d82107/users/a63ed9805a45496b870e96cfb17f0d4b/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:03.504640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.506813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.506813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.534177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] MFA Rules not processed for user `a63ed9805a45496b870e96cfb17f0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:03.535424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.561168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1369/2698] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:24:03 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:24:03.565843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.575605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06a9a-f0cc-4069-826e-31a7853b1947 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.579876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:03.608484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1330/2699] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:24:03.620743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.622250 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.640454 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.642651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.642651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.642651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.642651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.644134 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.654044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1370/2700] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:24:03.658670 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.669521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8a60f-0fa9-4157-b908-0354afd160b5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.675307 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.675949 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.676237 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.676522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.677205 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.678994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.691893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1371/2701] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:24:03.696161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.706011 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae708fa-3b0c-4de2-8679-812033f07af1 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.706614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adfadb-b6d2-43e8-8be6-2d996cc15e36 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.709668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8120c31-3374-410d-a692-b1959165b50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.710277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8120c31-3374-410d-a692-b1959165b50f service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.712311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8120c31-3374-410d-a692-b1959165b50f service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.712311 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8120c31-3374-410d-a692-b1959165b50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.712493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.712493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.712493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.712780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] PATH_INFO: `/v3/projects/832bb2bb73bf4a94bb41ab41682b1c34/users/259e4773318f4ef193ddfeaf15eaa6ce/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.720956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8120c31-3374-410d-a692-b1959165b50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.722564 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8120c31-3374-410d-a692-b1959165b50f service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.728815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832bb2bb73bf4a94bb41ab41682b1c34, user_id=259e4773318f4ef193ddfeaf15eaa6ce, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:03.731696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:03.735292 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1331/2702] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:24:03.812013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1372/2703] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:03 2022] PUT /identity/v3/projects/832bb2bb73bf4a94bb41ab41682b1c34/users/259e4773318f4ef193ddfeaf15eaa6ce/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:24:03.817277 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.817567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.817846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.837587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:03.838914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.858050 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:03.907475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1332/2704] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:24:03.917249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:03.918990 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:03.979476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc6a7-2d18-411a-9fcb-fef2ed587973 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:03.985232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2e853-b9a8-4044-81c8-ad7bc4c1304c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:03.987623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e853-b9a8-4044-81c8-ad7bc4c1304c service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:03.988189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e853-b9a8-4044-81c8-ad7bc4c1304c service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:03.988189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e853-b9a8-4044-81c8-ad7bc4c1304c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:03.993829 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:04.005044 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2e853-b9a8-4044-81c8-ad7bc4c1304c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:04.006535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2e853-b9a8-4044-81c8-ad7bc4c1304c service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:04.018476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1373/2705] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:04.067725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63c4b3-fdbb-4662-bad4-996eb97d3f3d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:04.071476 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:04.072128 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:04.072437 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:04.072716 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:04.074565 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:04.136457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:04.137938 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:04.147092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1333/2706] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:24:09.832464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc39ed-b346-483d-bc32-e4c816a46589 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:09.832925 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc39ed-b346-483d-bc32-e4c816a46589 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:09.836760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc39ed-b346-483d-bc32-e4c816a46589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:09.867148 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-29fc39ed-b346-483d-bc32-e4c816a46589 None None] MFA Rules not processed for user `259e4773318f4ef193ddfeaf15eaa6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:09.868996 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-29fc39ed-b346-483d-bc32-e4c816a46589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:09.957813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:09.964327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1374/2707] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:09.988739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:09.990233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:10.092491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c08b-1fe2-4b70-b65f-cbf9e39ec50e service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:10.099934 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:10.100688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:10.101179 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:10.101542 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:10.115931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:10.119255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:10.136802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1334/2708] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:24:13.298810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:13.299700 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:13.299978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:13.325365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] MFA Rules not processed for user `259e4773318f4ef193ddfeaf15eaa6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:13.325365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:13.328517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1375/2709] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:13.371850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:13.373284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:13.377453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:13.461914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1037-6d31-43bd-8c16-a4cabeddca46 service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:13.465762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1fb138bb984445a9187f782b47589c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:13.466382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:13.466668 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:13.466948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:13.469037 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:13.484226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:13.487919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:13.509998 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1335/2710] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:14.370245 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:14.371727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:14.384636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf170-8cd5-4d5d-9ad1-dc7b4ee2c045 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:14.390109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:14.390854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:14.391133 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:14.391596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:14.394216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:14.410078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:14.411695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9f215-532b-4ebf-b130-fc4c340c2f1d service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:14.423449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1376/2711] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:23.583704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=34 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:24.418126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=9 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:44.180509 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:44.190990 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec459-f3dd-467c-a60f-21d678209f57 service glance] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:44.196376 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:44.197056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:44.197337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:44.197617 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] PATH_INFO: `/v3/users/3177b8c9cac74432a8be75a02529f265` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:44.198718 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3177b8c9cac74432a8be75a02529f265)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:44.200653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:44.395424 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3177b8c9cac74432a8be75a02529f265'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:44.402748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3177b8c9cac74432a8be75a02529f265'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:44.403454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3177b8c9cac74432a8be75a02529f265'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:44.404066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3177b8c9cac74432a8be75a02529f265'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:44.485534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3177b8c9cac74432a8be75a02529f265'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:44.504687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1336/2712] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:24:44 2022] DELETE /identity/v3/users/3177b8c9cac74432a8be75a02529f265 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:44.509269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:44.509777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:44.509917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:44.529210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:44.530447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:44.593366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1377/2713] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:44.604026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:44.605473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:44.666350 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1813-300e-4196-9ed4-ab9e388368d7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:44.670312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:44.670922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:44.671204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:44.671502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:44.681611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:44.683060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:44.692618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1337/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:45.070268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:45.071781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:45.086014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a55e1-2b1d-4951-bbef-04ea4e1b0e1a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:45.091151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:45.091787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:45.092068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:45.092346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] PATH_INFO: `/v3/projects/c1445a61f5a84f11b4e7e5711da47261` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:45.093732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1445a61f5a84f11b4e7e5711da47261)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:45.095940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:45.208693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1445a61f5a84f11b4e7e5711da47261', 'request_id': 'req-caf46ae4-8635-4437-9749-130ef496e627'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.268550 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1445a61f5a84f11b4e7e5711da47261', 'request_id': 'req-caf46ae4-8635-4437-9749-130ef496e627'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.276147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1445a61f5a84f11b4e7e5711da47261', 'request_id': 'req-caf46ae4-8635-4437-9749-130ef496e627'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.286863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] The token cache is being invalidate because project c1445a61f5a84f11b4e7e5711da47261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:24:45.287155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.291247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.291247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1378/2715] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:24:45 2022] DELETE /identity/v3/projects/c1445a61f5a84f11b4e7e5711da47261 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:45.293464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:45.303588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383aaf3-4b85-4c76-9278-b35401ac6b17 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:45.360217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:45.360842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:45.361152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:45.361429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] PATH_INFO: `/v3/users/a63ed9805a45496b870e96cfb17f0d4b` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:45.362538 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63ed9805a45496b870e96cfb17f0d4b)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:45.364496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:45.381791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:45.591138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63ed9805a45496b870e96cfb17f0d4b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.598024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63ed9805a45496b870e96cfb17f0d4b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.598641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63ed9805a45496b870e96cfb17f0d4b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.599281 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63ed9805a45496b870e96cfb17f0d4b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.677827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f761ecdf-75a2-4ea8-a999-9d1c2f727be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63ed9805a45496b870e96cfb17f0d4b'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:45.696892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1338/2716] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:24:45 2022] DELETE /identity/v3/users/a63ed9805a45496b870e96cfb17f0d4b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:46.106501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:46.112346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:46.126173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46ae4-8635-4437-9749-130ef496e627 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:46.184423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:46.185136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:46.185419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:46.185695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] PATH_INFO: `/v3/projects/c4da532047d545828f9d3b2cc2d82107` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:46.186806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4da532047d545828f9d3b2cc2d82107)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:46.188702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:46.355893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:46.372423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4da532047d545828f9d3b2cc2d82107', 'request_id': 'req-07eb2d9e-f520-45c0-b235-2bf7e62385a9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:46.502529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4da532047d545828f9d3b2cc2d82107', 'request_id': 'req-07eb2d9e-f520-45c0-b235-2bf7e62385a9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:46.513768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4da532047d545828f9d3b2cc2d82107', 'request_id': 'req-07eb2d9e-f520-45c0-b235-2bf7e62385a9'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:46.526622 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] The token cache is being invalidate because project c4da532047d545828f9d3b2cc2d82107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:24:46.527120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:46.528084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-07eb2d9e-f520-45c0-b235-2bf7e62385a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:24:46.529712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1379/2717] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:24:46 2022] DELETE /identity/v3/projects/c4da532047d545828f9d3b2cc2d82107 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:46.534699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:46.535741 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:46.536498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:46.556206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:46.557523 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:46.624923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1339/2718] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:46.633905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:46.634199 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:46.634481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:46.657186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:46.658406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:46.667534 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1380/2719] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:24:46.671975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:46.682540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcae5af-9769-4f44-b3d1-bffdcc23008d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:46.687080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:46.694285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:46.694285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:46.694285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:46.694285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:24:46.694285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:46.694285 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:46.703009 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1340/2720] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:24:46.707970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:46.717532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c197cc3-6616-404c-ba75-06afb971acf5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:46.722181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:46.722809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:46.723174 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:46.723374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:46.724017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:46.726182 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:46.864171 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1381/2721] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:24:46 2022] POST /identity/v3/projects => generated 357 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:24:46.868499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:46.879580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b59a3-b6a1-4926-b5c6-d3bf59f585e5 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:46.936455 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:46.937104 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:46.937423 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:46.937713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:46.938371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:46.940401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.034470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1341/2722] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:24:46 2022] POST /identity/v3/users => generated 279 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:24:47.038798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.049015 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f41d75-4ae2-4d35-abb5-ac30605801cc admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.054363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.054973 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.055242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.055519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.056175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.057856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.068728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1382/2723] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:24:47.080022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.091190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237e1ac-80d6-4a4e-bfdf-a8c91426c6c2 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.095955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b31651-6421-41b0-97ae-1f98fb143b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.096582 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b31651-6421-41b0-97ae-1f98fb143b4f admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.096871 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b31651-6421-41b0-97ae-1f98fb143b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.097199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b31651-6421-41b0-97ae-1f98fb143b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.097883 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b31651-6421-41b0-97ae-1f98fb143b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.099491 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b31651-6421-41b0-97ae-1f98fb143b4f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.104884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:47.110607 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1342/2724] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:24:47.115477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.125521 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f093f-04d9-40fe-b914-8e73ee4d08f9 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.131721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.131885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.132203 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.132486 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] PATH_INFO: `/v3/projects/ff7c323668274f56a1cd14e123c81891/users/7cce3b741917486ea35d0acb40a33359/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.148266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7c323668274f56a1cd14e123c81891, user_id=7cce3b741917486ea35d0acb40a33359, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.151013 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.248997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1383/2725] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:47 2022] PUT /identity/v3/projects/ff7c323668274f56a1cd14e123c81891/users/7cce3b741917486ea35d0acb40a33359/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:47.260069 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.260353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.260630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.288764 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] MFA Rules not processed for user `7cce3b741917486ea35d0acb40a33359`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:47.290063 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:47.356783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1343/2726] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:47.361530 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.430377 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326378f5-d3b5-463d-bde8-032866765424 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.435334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.435950 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.436233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.436509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.437192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.439140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.550399 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1384/2727] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:24:47 2022] POST /identity/v3/projects => generated 357 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:24:47.554516 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.565504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d35ab-241b-41b0-8b5f-c575cb70fe29 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.623333 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.623949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.624262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.624539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.625255 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.627182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.751785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1344/2728] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:24:47 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:24:47.756664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.767675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c875c-07f7-4aa1-abd4-5c89208edd1e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.773138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.773746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.774026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.774308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.774956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.776593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.787964 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1385/2729] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:24:47.792237 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.803016 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec79a-36a1-44a0-a3da-2250020ffb94 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.807779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:47.808427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:47.808711 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:47.809080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] PATH_INFO: `/v3/projects/55b751f5b73c4f439f938cedcf0c196f/users/d21fefa112d7478abf16b878456dce45/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:47.824989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b751f5b73c4f439f938cedcf0c196f, user_id=d21fefa112d7478abf16b878456dce45, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:47.827745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:47.946821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1345/2730] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:47 2022] PUT /identity/v3/projects/55b751f5b73c4f439f938cedcf0c196f/users/d21fefa112d7478abf16b878456dce45/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:47.950791 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:47.960868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afc54b-e8a7-40dd-9373-dbd19ce2c2dc admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:47.981536 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:48.018638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d88c4-a16d-4f9f-919f-ac4df2444742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:48.019170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d88c4-a16d-4f9f-919f-ac4df2444742 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:48.019713 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d88c4-a16d-4f9f-919f-ac4df2444742 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:48.020026 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d88c4-a16d-4f9f-919f-ac4df2444742 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:48.020675 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d88c4-a16d-4f9f-919f-ac4df2444742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:48.022395 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d88c4-a16d-4f9f-919f-ac4df2444742 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:48.032346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1386/2731] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:24:48.036785 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:48.047134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c95dc-fbb7-43f6-8c86-930ae622368f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:48.052519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:48.054239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:48.054239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:48.054239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] PATH_INFO: `/v3/projects/55b751f5b73c4f439f938cedcf0c196f/users/d21fefa112d7478abf16b878456dce45/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:48.055802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b751f5b73c4f439f938cedcf0c196f, user_id=d21fefa112d7478abf16b878456dce45, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:48.058465 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:48.070116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1346/2732] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:24:48 2022] PUT /identity/v3/projects/55b751f5b73c4f439f938cedcf0c196f/users/d21fefa112d7478abf16b878456dce45/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:24:48.081594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:48.081896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:48.088224 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:48.109712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] MFA Rules not processed for user `d21fefa112d7478abf16b878456dce45`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:48.110943 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:48.186183 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1387/2733] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:48.197793 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:48.199667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:48.246305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:48.258266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe6dd-67b2-439b-87a0-06f431a4b91f admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:48.262022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:48.262624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:48.262910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:48.263193 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:48.272185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:48.273663 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:48.283715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1347/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:48.506649 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:48.516736 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe27e-431b-4242-9f6e-8ff96b096f4b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:48.521354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a76b-9d87-4ca0-beb8-06c378ddcd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:48.521959 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a76b-9d87-4ca0-beb8-06c378ddcd33 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:48.522288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a76b-9d87-4ca0-beb8-06c378ddcd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:48.522529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a76b-9d87-4ca0-beb8-06c378ddcd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:48.580014 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a76b-9d87-4ca0-beb8-06c378ddcd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:48.581503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a76b-9d87-4ca0-beb8-06c378ddcd33 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:48.591200 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1388/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:58.313866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=7 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:58.587322 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=80 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:06.845413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:06.923539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab913b-f1f6-45a2-aa9d-130149931b45 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:06.928495 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:06.929165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:06.929451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:06.929728 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] PATH_INFO: `/v3/users/7cce3b741917486ea35d0acb40a33359` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:06.931506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cce3b741917486ea35d0acb40a33359)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:06.933637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:07.146953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cce3b741917486ea35d0acb40a33359'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:07.154149 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cce3b741917486ea35d0acb40a33359'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:07.154858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cce3b741917486ea35d0acb40a33359'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:07.155475 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cce3b741917486ea35d0acb40a33359'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:07.219629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cce3b741917486ea35d0acb40a33359'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:07.239734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1348/2736] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:06 2022] DELETE /identity/v3/users/7cce3b741917486ea35d0acb40a33359 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:07.244215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:07.244716 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:07.244823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:07.266764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:07.267976 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:07.327392 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1389/2737] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:07.338384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:07.339806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:07.398978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011103d-7e78-4241-b4d5-1a9753c3a7fe admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:07.402651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:07.403266 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:07.403552 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:07.403834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:07.413697 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:07.415168 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:07.424756 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1349/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:07.855481 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:07.857105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:07.870091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607240-8258-42cc-b859-c3e388aeb986 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:07.875067 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:07.875696 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:07.875981 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:07.876263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] PATH_INFO: `/v3/projects/ff7c323668274f56a1cd14e123c81891` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:07.877483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7c323668274f56a1cd14e123c81891)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:07.880054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:07.989011 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7c323668274f56a1cd14e123c81891', 'request_id': 'req-d2496a80-4faa-4deb-b1ac-fafb246f7abf'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.073773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7c323668274f56a1cd14e123c81891', 'request_id': 'req-d2496a80-4faa-4deb-b1ac-fafb246f7abf'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.080561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7c323668274f56a1cd14e123c81891', 'request_id': 'req-d2496a80-4faa-4deb-b1ac-fafb246f7abf'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.091210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] The token cache is being invalidate because project ff7c323668274f56a1cd14e123c81891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:08.091509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.092156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.093678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1390/2739] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:07 2022] DELETE /identity/v3/projects/ff7c323668274f56a1cd14e123c81891 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:08.097770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:08.107551 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041a2a3-978e-43e3-afda-b9a02dcc84e5 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:08.126352 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:08.164821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:08.165484 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:08.165772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:08.166053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] PATH_INFO: `/v3/users/d21fefa112d7478abf16b878456dce45` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:08.167181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21fefa112d7478abf16b878456dce45)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:08.169174 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:08.334118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21fefa112d7478abf16b878456dce45'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.341479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21fefa112d7478abf16b878456dce45'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.342217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21fefa112d7478abf16b878456dce45'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.342824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21fefa112d7478abf16b878456dce45'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.420219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6ccddc10-0b8d-4d98-9a2c-2f8226cda494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21fefa112d7478abf16b878456dce45'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:08.439371 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1350/2740] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:08 2022] DELETE /identity/v3/users/d21fefa112d7478abf16b878456dce45 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:08.879483 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:08.881248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:08.897801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2496a80-4faa-4deb-b1ac-fafb246f7abf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:08.970079 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:08.970801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:08.971080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:08.971363 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] PATH_INFO: `/v3/projects/55b751f5b73c4f439f938cedcf0c196f` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:08.973846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b751f5b73c4f439f938cedcf0c196f)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:08.975807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:09.087526 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:09.104765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b751f5b73c4f439f938cedcf0c196f', 'request_id': 'req-052516f5-732e-4108-b12d-8649b2277d59'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:09.222995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b751f5b73c4f439f938cedcf0c196f', 'request_id': 'req-052516f5-732e-4108-b12d-8649b2277d59'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:09.230490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b751f5b73c4f439f938cedcf0c196f', 'request_id': 'req-052516f5-732e-4108-b12d-8649b2277d59'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:09.243082 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] The token cache is being invalidate because project 55b751f5b73c4f439f938cedcf0c196f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:09.243554 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:09.244258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-052516f5-732e-4108-b12d-8649b2277d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:09.246150 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1391/2741] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:08 2022] DELETE /identity/v3/projects/55b751f5b73c4f439f938cedcf0c196f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:09.251030 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.251596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.251596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.275512 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:09.276807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:09.344367 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1351/2742] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:09.352739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.353069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.353346 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.373879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:09.375068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:09.383492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1392/2743] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:09.388056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:09.400571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bdc88-3b3d-4658-a303-2211714f4537 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:09.405555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:09.406190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.406477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.406759 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.407428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:25:09.407892 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:09.409441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:09.422421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1352/2744] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:25:09.427671 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:09.438088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4e66-e965-452b-8a59-dabba5641ab5 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:09.444066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:09.444766 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.445158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.445506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.446246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:09.448264 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:09.563863 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1393/2745] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:09 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:25:09.568847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:09.578895 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8646-e532-40e7-b1af-7700729cd122 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:09.607083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:09.641036 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:09.641651 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.641936 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.642222 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.643006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:09.645388 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:09.857373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1353/2746] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:09 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:09.861559 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:09.879707 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8601-a30e-41bc-8436-52eb3f9eb65b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:09.884443 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:09.885092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.885381 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.885661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.886314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:09.888040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:09.898744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1394/2747] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:09.902916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:09.913415 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98310df-3943-4262-8d48-a9e05e17a467 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:09.918051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea33b82-989e-4af9-b8d7-43b2e0c9c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:09.918649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33b82-989e-4af9-b8d7-43b2e0c9c19e admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.918928 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33b82-989e-4af9-b8d7-43b2e0c9c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.919205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33b82-989e-4af9-b8d7-43b2e0c9c19e admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.919850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea33b82-989e-4af9-b8d7-43b2e0c9c19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:09.921469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea33b82-989e-4af9-b8d7-43b2e0c9c19e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:09.932202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1354/2748] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:09.936347 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:09.947078 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eaa5b-32bf-4bf2-8ce1-086524eb1a9d admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:09.951659 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:09.952308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:09.952592 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:09.952871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] PATH_INFO: `/v3/projects/cf42f50dd22f4cb8b1edaa20856dc4ba/users/55c177eef173495aabb2c5f1a8606fad/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:09.968084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf42f50dd22f4cb8b1edaa20856dc4ba, user_id=55c177eef173495aabb2c5f1a8606fad, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:09.970846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.083248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1395/2749] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:09 2022] PUT /identity/v3/projects/cf42f50dd22f4cb8b1edaa20856dc4ba/users/55c177eef173495aabb2c5f1a8606fad/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:10.094735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.095103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.095381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.124454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] MFA Rules not processed for user `55c177eef173495aabb2c5f1a8606fad`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:10.125632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:10.190632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.192461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:10.193497 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1355/2750] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:10.197681 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.262162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ebe14-b32b-4a71-9fa3-fda352843b5a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.263558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10d06-1c03-44c7-bbb7-1e5cd3552218 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.265877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.266503 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.266789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.267070 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.268245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.268850 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:10.269494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.269725 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.270006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.270644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.272543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.279538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.281135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.289897 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1396/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:25:10.364740 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1356/2752] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:10 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:25:10.366262 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.378343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4b95-28c2-4e29-bb1c-885838d6f098 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.428442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:10.437054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.438801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.438801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.438801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.439188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.440741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.549122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1397/2753] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:10 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:10.554084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.564832 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd7e61-9621-4d62-bb86-e9e9bf12e5ef admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.569789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.570430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.570714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.570988 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.573006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.573278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.587761 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1357/2754] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:10.593886 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.600729 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5074-037c-4d40-945c-ae8ca895a3e1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.605506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.606170 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.606459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.606740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] PATH_INFO: `/v3/projects/dab702910603486aa142ca46422f5390/users/42f644459fbb4a9eb49bb0ea5110b000/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.622666 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab702910603486aa142ca46422f5390, user_id=42f644459fbb4a9eb49bb0ea5110b000, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.625476 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.755447 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1398/2755] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:10 2022] PUT /identity/v3/projects/dab702910603486aa142ca46422f5390/users/42f644459fbb4a9eb49bb0ea5110b000/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:10.761177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.770524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c3b6b-2573-4cf9-b37e-6dc7ee915368 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.783499 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:10.837127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772001fe-ad3c-455b-9a3c-eec9ac5f4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.838048 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772001fe-ad3c-455b-9a3c-eec9ac5f4616 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.838358 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772001fe-ad3c-455b-9a3c-eec9ac5f4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.838636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772001fe-ad3c-455b-9a3c-eec9ac5f4616 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.839304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772001fe-ad3c-455b-9a3c-eec9ac5f4616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.840885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772001fe-ad3c-455b-9a3c-eec9ac5f4616 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.851368 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1358/2756] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:10.855626 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:10.866904 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef023-68c0-41ca-b672-0a87cd658cb5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:10.871627 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:10.872331 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.872611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.872883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] PATH_INFO: `/v3/projects/dab702910603486aa142ca46422f5390/users/42f644459fbb4a9eb49bb0ea5110b000/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.874869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab702910603486aa142ca46422f5390, user_id=42f644459fbb4a9eb49bb0ea5110b000, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:10.877524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:10.887884 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1399/2757] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:10 2022] PUT /identity/v3/projects/dab702910603486aa142ca46422f5390/users/42f644459fbb4a9eb49bb0ea5110b000/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:10.898298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:10.898581 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:10.898865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:10.928365 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] MFA Rules not processed for user `42f644459fbb4a9eb49bb0ea5110b000`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:10.930164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:11.001224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1359/2758] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:11.012646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:11.014376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:11.072303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18954deb-1c68-49e3-a5b9-b8d6638d8f3b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:11.076138 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:11.076745 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:11.077068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:11.077348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:11.087154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:11.088859 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:11.098946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1400/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:11.319271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:11.330187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9390c-515b-4461-bfbd-034607f2d5b7 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:11.335970 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05aa2d-2265-44a8-b109-591ca47e27df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:11.336642 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05aa2d-2265-44a8-b109-591ca47e27df service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:11.336977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05aa2d-2265-44a8-b109-591ca47e27df service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:11.337560 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05aa2d-2265-44a8-b109-591ca47e27df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:11.396696 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05aa2d-2265-44a8-b109-591ca47e27df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:11.398160 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05aa2d-2265-44a8-b109-591ca47e27df service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:11.407084 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1360/2760] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:15.192288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:15.255588 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140f734-1288-4bdd-a02c-259fcffcb0ab service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:15.261371 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:15.262268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:15.262680 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:15.263085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] PATH_INFO: `/v3/users/55c177eef173495aabb2c5f1a8606fad` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:15.264753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c177eef173495aabb2c5f1a8606fad)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:15.267767 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:15.445164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c177eef173495aabb2c5f1a8606fad'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:15.445872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c177eef173495aabb2c5f1a8606fad'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:15.448004 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:15.453155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c177eef173495aabb2c5f1a8606fad'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:15.522463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c177eef173495aabb2c5f1a8606fad'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:15.535432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c177eef173495aabb2c5f1a8606fad'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:15.541855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1401/2761] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:15 2022] DELETE /identity/v3/users/55c177eef173495aabb2c5f1a8606fad => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:15.546375 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:15.546804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:15.546932 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:15.566131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:15.567359 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:15.593511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:15.633432 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1361/2762] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:15.640807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:15.642740 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:15.708002 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076b6a-47a6-41d3-9ef5-dc2296766ce2 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:15.711836 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:15.712807 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:15.713131 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:15.713414 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:15.723572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:15.725139 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:15.735122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1402/2763] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:15.907960 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:15.909440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:15.996074 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69904-06d3-4a69-98ce-cb4f91c2ef1d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:16.001164 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:16.001782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:16.002070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:16.002355 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:16.005485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:16.018630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:16.020738 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:16.031412 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1362/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:16.134185 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:16.135473 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:16.150524 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a0e4c-4f9e-421a-b590-74518067967c service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:16.155684 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:16.156323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:16.156702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:16.157000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] PATH_INFO: `/v3/projects/cf42f50dd22f4cb8b1edaa20856dc4ba` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:16.158535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf42f50dd22f4cb8b1edaa20856dc4ba)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:16.160155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:16.280845 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf42f50dd22f4cb8b1edaa20856dc4ba', 'request_id': 'req-abe176ef-3049-4c9b-a7e4-b8a493bf9841'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.396576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf42f50dd22f4cb8b1edaa20856dc4ba', 'request_id': 'req-abe176ef-3049-4c9b-a7e4-b8a493bf9841'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.403320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf42f50dd22f4cb8b1edaa20856dc4ba', 'request_id': 'req-abe176ef-3049-4c9b-a7e4-b8a493bf9841'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.413816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] The token cache is being invalidate because project cf42f50dd22f4cb8b1edaa20856dc4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:16.414110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.414752 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.416231 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1403/2765] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:16 2022] DELETE /identity/v3/projects/cf42f50dd22f4cb8b1edaa20856dc4ba => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:16.420403 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:16.431608 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ae071-a557-48f4-9d36-f5700d34433a service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:16.496377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:16.497057 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:16.497346 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:16.497631 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] PATH_INFO: `/v3/users/42f644459fbb4a9eb49bb0ea5110b000` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:16.498787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f644459fbb4a9eb49bb0ea5110b000)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:16.500736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:16.722625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f644459fbb4a9eb49bb0ea5110b000'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.731557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f644459fbb4a9eb49bb0ea5110b000'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.732296 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f644459fbb4a9eb49bb0ea5110b000'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.733143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f644459fbb4a9eb49bb0ea5110b000'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.759320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:16.760739 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:16.820179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:16.851458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f644459fbb4a9eb49bb0ea5110b000'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:16.853392 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:16.864694 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe176ef-3049-4c9b-a7e4-b8a493bf9841 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:16.880055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1363/2766] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:16 2022] DELETE /identity/v3/users/42f644459fbb4a9eb49bb0ea5110b000 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:16.881389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:16.882047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:16.882334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:16.882608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:16.884962 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:16.901354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:16.903296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb8d9f-d568-4040-95f2-460ffacc2548 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:16.921864 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1404/2767] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:25:17.423186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:17.423186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:17.495919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbbab3-a155-4c70-9d6d-a12b97061a62 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:17.500574 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:17.501249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:17.501539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:17.501818 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] PATH_INFO: `/v3/projects/dab702910603486aa142ca46422f5390` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:17.502949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab702910603486aa142ca46422f5390)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:17.505457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:17.620312 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab702910603486aa142ca46422f5390', 'request_id': 'req-001a2623-cd58-4d64-930a-f11afdaadb69'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:17.627397 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab702910603486aa142ca46422f5390', 'request_id': 'req-001a2623-cd58-4d64-930a-f11afdaadb69'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:17.633683 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab702910603486aa142ca46422f5390', 'request_id': 'req-001a2623-cd58-4d64-930a-f11afdaadb69'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:17.733646 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] The token cache is being invalidate because project dab702910603486aa142ca46422f5390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:17.734332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:17.734485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-001a2623-cd58-4d64-930a-f11afdaadb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:17.736042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1364/2768] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:17 2022] DELETE /identity/v3/projects/dab702910603486aa142ca46422f5390 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:17.741760 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:17.742259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:17.742375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:17.763327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:17.764578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:17.825811 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1405/2769] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:17.834239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:17.834535 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:17.834880 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:17.855704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:17.856924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:17.865625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1365/2770] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:17.870035 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:17.880803 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b90c-e936-4169-9661-612b86bd8917 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:17.885598 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:17.886230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:17.886508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:17.886780 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:17.887427 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:25:17.887824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:17.889442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:17.901464 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1406/2771] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:25:17.906087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:17.916027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e44f5f-f249-4944-a14f-1798439f2ab8 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:17.920786 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:17.921429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:17.921717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:17.921994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:17.922629 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:17.924675 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.013389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1366/2772] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:17 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:25:18.017645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.028442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae319b-da0a-4392-8401-caf30eff9396 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.088832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.089493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.089781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.090061 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.090715 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.092650 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.185685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1407/2773] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:18 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:18.189925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.200917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414289-1654-4222-a30d-6a45aa0a117a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.206162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.206862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.207252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.207645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.208645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.210689 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.222628 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1367/2774] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:25:18.227718 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.237868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66129c7e-ce9a-4fea-a904-a4cf67d797d0 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.243430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7034-808e-4eef-9da7-17c34cba1fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.244106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7034-808e-4eef-9da7-17c34cba1fee admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.244394 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7034-808e-4eef-9da7-17c34cba1fee admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.244676 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7034-808e-4eef-9da7-17c34cba1fee admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.245375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e7034-808e-4eef-9da7-17c34cba1fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.246991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e7034-808e-4eef-9da7-17c34cba1fee admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.258769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1408/2775] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:18.267820 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.278386 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe10113-581b-41a7-86f7-95caadcd56cb admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.283273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.283978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.284343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.284691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] PATH_INFO: `/v3/projects/522b0e33cdf54245a7bd37228c5f7e8e/users/885acba6ecbd409b836545891f56ff06/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.301344 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522b0e33cdf54245a7bd37228c5f7e8e, user_id=885acba6ecbd409b836545891f56ff06, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.304930 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.408479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1368/2776] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:18 2022] PUT /identity/v3/projects/522b0e33cdf54245a7bd37228c5f7e8e/users/885acba6ecbd409b836545891f56ff06/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:18.420687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.421030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.421343 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.449734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] MFA Rules not processed for user `885acba6ecbd409b836545891f56ff06`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:18.450936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:18.484269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:18.516860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1409/2777] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:18.522521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.531781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:18.585996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372deed-3f37-4a15-a430-a3fde23001b1 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.590982 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.591589 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.591876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.592159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.592792 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.594730 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.690775 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1369/2778] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:18 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:18.694239 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.707508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410724a-9a55-4e47-a6a2-c72c1214856d None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.780166 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.780846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.780965 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.781244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.781885 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.783871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.891878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1410/2779] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:18 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:18.897176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.908810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee999cf2-f98f-4ecb-ab20-59d831cd0092 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.913219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.913859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.914143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.914433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.915223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.916862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:18.928585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1370/2780] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:18.934704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:18.948126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e1ef-8288-444f-bfb4-b0c59a5ccbfa admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:18.953875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:18.954584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:18.954900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:18.955186 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] PATH_INFO: `/v3/projects/abc982957c3b40779d292ee526b3385c/users/6240b7845659480b81d4f2527716d775/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:18.972142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc982957c3b40779d292ee526b3385c, user_id=6240b7845659480b81d4f2527716d775, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:18.975223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:19.116327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1411/2781] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:18 2022] PUT /identity/v3/projects/abc982957c3b40779d292ee526b3385c/users/6240b7845659480b81d4f2527716d775/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:19.120384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:19.132596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1402-c5a7-4515-bac5-856058709860 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:19.199127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf197-924b-434d-b6ec-55fb6ebca893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:19.199801 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf197-924b-434d-b6ec-55fb6ebca893 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:19.200064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf197-924b-434d-b6ec-55fb6ebca893 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:19.200318 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf197-924b-434d-b6ec-55fb6ebca893 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:19.201013 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf197-924b-434d-b6ec-55fb6ebca893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:19.202648 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf197-924b-434d-b6ec-55fb6ebca893 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:19.217795 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1371/2782] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:19.219068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:19.230819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458fa22-b587-44fd-ae7c-34df42ebca14 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:19.236361 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:19.237085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:19.241453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:19.241453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] PATH_INFO: `/v3/projects/abc982957c3b40779d292ee526b3385c/users/6240b7845659480b81d4f2527716d775/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:19.242792 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc982957c3b40779d292ee526b3385c, user_id=6240b7845659480b81d4f2527716d775, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:19.245860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:19.259055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1412/2783] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:19 2022] PUT /identity/v3/projects/abc982957c3b40779d292ee526b3385c/users/6240b7845659480b81d4f2527716d775/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:19.278217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:19.278217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:19.278217 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:19.310513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] MFA Rules not processed for user `6240b7845659480b81d4f2527716d775`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:19.311973 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:19.393271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1372/2784] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:19.406219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:19.409832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:19.470980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e074e3-6ad6-4a73-a064-5e046a9e21b8 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:19.476610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:19.477269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:19.477556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:19.477834 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:19.490333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:19.492294 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:19.502733 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1413/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:19.697029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:19.701768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:19.707373 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0540fb8-d1ba-48fb-a71a-fbd091864f11 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:19.711315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce490bb1-0d2c-4035-89ed-080b3a75b172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:19.711931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce490bb1-0d2c-4035-89ed-080b3a75b172 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:19.712215 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce490bb1-0d2c-4035-89ed-080b3a75b172 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:19.712762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce490bb1-0d2c-4035-89ed-080b3a75b172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:19.774361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce490bb1-0d2c-4035-89ed-080b3a75b172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:19.775866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce490bb1-0d2c-4035-89ed-080b3a75b172 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:19.787898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1373/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:20.302687 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:20.336686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:20.370251 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bd71b-813d-4f60-9bb1-8141a2a07ef3 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:20.375025 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:20.375910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:20.375910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:20.376190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] PATH_INFO: `/v3/users/885acba6ecbd409b836545891f56ff06` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:20.377340 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885acba6ecbd409b836545891f56ff06)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:20.380665 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:20.616640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885acba6ecbd409b836545891f56ff06'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:20.617316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885acba6ecbd409b836545891f56ff06'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:20.624084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885acba6ecbd409b836545891f56ff06'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:20.711164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885acba6ecbd409b836545891f56ff06'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:20.724853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885acba6ecbd409b836545891f56ff06'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:20.730828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1414/2787] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:20 2022] DELETE /identity/v3/users/885acba6ecbd409b836545891f56ff06 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:20.735513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:20.736080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:20.736080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:20.761284 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:20.765677 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:20.829797 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1374/2788] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:20.839817 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:20.841241 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:20.909646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7169-5559-4f18-9cf6-c1f507097893 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:20.913406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:20.914028 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:20.914305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:20.914583 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:20.928003 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:20.929511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:20.942408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1415/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:21.447907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:21.449382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:21.466882 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06708196-7409-4262-acb7-2df489d99dd9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:21.475204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:21.476003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:21.476482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:21.476989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] PATH_INFO: `/v3/projects/522b0e33cdf54245a7bd37228c5f7e8e` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:21.478439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522b0e33cdf54245a7bd37228c5f7e8e)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:21.480420 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:21.640090 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522b0e33cdf54245a7bd37228c5f7e8e', 'request_id': 'req-99ad32d7-9a50-4719-badd-4bd45f7045b8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:21.648022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522b0e33cdf54245a7bd37228c5f7e8e', 'request_id': 'req-99ad32d7-9a50-4719-badd-4bd45f7045b8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:21.654502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522b0e33cdf54245a7bd37228c5f7e8e', 'request_id': 'req-99ad32d7-9a50-4719-badd-4bd45f7045b8'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:21.778968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] The token cache is being invalidate because project 522b0e33cdf54245a7bd37228c5f7e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:21.779546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:21.780039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:21.781743 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1375/2790] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:21 2022] DELETE /identity/v3/projects/522b0e33cdf54245a7bd37228c5f7e8e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:21.785695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:21.796621 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01feac31-8b64-4b1d-b956-8f51280636f3 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:21.843741 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:21.854048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:21.859754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:21.859754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:21.859754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] PATH_INFO: `/v3/users/6240b7845659480b81d4f2527716d775` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:21.859754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6240b7845659480b81d4f2527716d775)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:21.859754 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:22.073599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6240b7845659480b81d4f2527716d775'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.074258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6240b7845659480b81d4f2527716d775'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.081488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6240b7845659480b81d4f2527716d775'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.159839 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6240b7845659480b81d4f2527716d775'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.174304 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-bccc90f7-7105-490a-853b-cc5b33b17ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6240b7845659480b81d4f2527716d775'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.181142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1416/2791] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:21 2022] DELETE /identity/v3/users/6240b7845659480b81d4f2527716d775 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:22.643513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:22.644961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:22.660330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad32d7-9a50-4719-badd-4bd45f7045b8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:22.682810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:22.724235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:22.725972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:22.726316 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:22.726708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] PATH_INFO: `/v3/projects/abc982957c3b40779d292ee526b3385c` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:22.727799 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc982957c3b40779d292ee526b3385c)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:22.729771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:22.847679 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc982957c3b40779d292ee526b3385c', 'request_id': 'req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.854863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc982957c3b40779d292ee526b3385c', 'request_id': 'req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.860995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc982957c3b40779d292ee526b3385c', 'request_id': 'req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.931546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] The token cache is being invalidate because project abc982957c3b40779d292ee526b3385c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:22.932054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.932758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-d8af6e7c-37e8-4aa9-87c3-83eb422ebc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:22.934521 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1376/2792] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:22 2022] DELETE /identity/v3/projects/abc982957c3b40779d292ee526b3385c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:22.940281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:22.942102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:22.942102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:22.961375 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:22.962870 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:23.025091 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1417/2793] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:25:23.092955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.093247 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.093532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.113815 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:23.115024 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:23.122907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1377/2794] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:23.127179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.136804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0afc-d41e-4ff2-bc5c-321c70a297ce None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.141384 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.141984 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.142268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.142543 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.143194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:25:23.143497 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.145122 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.157286 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1418/2795] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:25:23.162138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.171244 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a345-8d9a-47b9-80e2-95db7a5770e6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.176520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.177218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.177507 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.177784 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.178428 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.180332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.258042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1378/2796] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:23 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:25:23.262295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.273106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529321-c859-45d8-b735-785d3db17c88 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.323068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:23.329038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.329643 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.329931 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.330213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.330843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.332784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.446271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1419/2797] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:23 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:23.450520 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.461657 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7e3f-e834-451e-9a5b-9abc6aafb9c6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.466533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.467147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.467418 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.467701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.468345 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.469965 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.480272 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1379/2798] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:23.484247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.494218 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab49d3e-f83c-4d0e-b957-02afeabec6f6 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.499277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ae53-bd3d-4b49-b9ef-36c776dd868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.499872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ae53-bd3d-4b49-b9ef-36c776dd868c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.500156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ae53-bd3d-4b49-b9ef-36c776dd868c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.500432 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ae53-bd3d-4b49-b9ef-36c776dd868c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.501112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ae53-bd3d-4b49-b9ef-36c776dd868c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.502727 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ae53-bd3d-4b49-b9ef-36c776dd868c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.519858 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1420/2799] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:23.521643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.531618 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18482-b4c0-4798-8795-fbdc580afc8c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.536182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.536807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.537202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.537488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] PATH_INFO: `/v3/projects/068b6504c8db49c2a9be1a9bdc714b09/users/72a43f352db045078a4c043e8326db44/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.553254 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068b6504c8db49c2a9be1a9bdc714b09, user_id=72a43f352db045078a4c043e8326db44, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.555887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.631623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1380/2800] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:23 2022] PUT /identity/v3/projects/068b6504c8db49c2a9be1a9bdc714b09/users/72a43f352db045078a4c043e8326db44/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:23.642092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.642378 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.642652 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.670494 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] MFA Rules not processed for user `72a43f352db045078a4c043e8326db44`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:23.678259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:23.740209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1421/2801] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:23.755985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:23.758006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:23.817724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbbef-bad8-497d-9e8f-b6e276cfefd1 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:23.821630 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433ada2-cf6a-4fca-ae4d-cd7d4a1f5b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:23.822239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ada2-cf6a-4fca-ae4d-cd7d4a1f5b15 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:23.822524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ada2-cf6a-4fca-ae4d-cd7d4a1f5b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:23.822804 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ada2-cf6a-4fca-ae4d-cd7d4a1f5b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:23.828035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:23.831644 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433ada2-cf6a-4fca-ae4d-cd7d4a1f5b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:23.833708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433ada2-cf6a-4fca-ae4d-cd7d4a1f5b15 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:23.843690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1381/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:26.875034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:26.941631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed421c35-ef81-4c20-8613-efb9baf45882 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:26.947173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:26.947844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:26.948572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:26.948572 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] PATH_INFO: `/v3/users/72a43f352db045078a4c043e8326db44` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:26.949535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a43f352db045078a4c043e8326db44)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:26.951501 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:27.155196 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a43f352db045078a4c043e8326db44'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:27.155854 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a43f352db045078a4c043e8326db44'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:27.163515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a43f352db045078a4c043e8326db44'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:27.251059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a43f352db045078a4c043e8326db44'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:27.256686 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:27.264830 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a43f352db045078a4c043e8326db44'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:27.274412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1422/2803] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:26 2022] DELETE /identity/v3/users/72a43f352db045078a4c043e8326db44 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:25:27.276080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:27.276595 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:27.276699 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:27.295910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:27.297211 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:27.361186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1382/2804] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:25:27.371271 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:27.372725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:27.430905 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350931a-962d-4aa9-8914-2b2e655fdf9a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:27.434471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76cc7e-6585-4041-8960-a6ca997c4bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:27.435068 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76cc7e-6585-4041-8960-a6ca997c4bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:27.435350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76cc7e-6585-4041-8960-a6ca997c4bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:27.435634 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76cc7e-6585-4041-8960-a6ca997c4bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:27.445096 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76cc7e-6585-4041-8960-a6ca997c4bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:27.446529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76cc7e-6585-4041-8960-a6ca997c4bb1 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:27.455894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1423/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:27.910558 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:27.913088 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:27.930361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635e84d-65c9-4234-ba92-038012a92c18 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:27.936917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:27.937702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:27.938034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:27.938269 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] PATH_INFO: `/v3/projects/068b6504c8db49c2a9be1a9bdc714b09` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:27.939464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068b6504c8db49c2a9be1a9bdc714b09)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:27.941477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.104460 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068b6504c8db49c2a9be1a9bdc714b09', 'request_id': 'req-12c7844d-cffa-4c88-94de-77b5d0e3ea02'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:28.110760 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068b6504c8db49c2a9be1a9bdc714b09', 'request_id': 'req-12c7844d-cffa-4c88-94de-77b5d0e3ea02'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:28.117600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068b6504c8db49c2a9be1a9bdc714b09', 'request_id': 'req-12c7844d-cffa-4c88-94de-77b5d0e3ea02'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:28.211183 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] The token cache is being invalidate because project 068b6504c8db49c2a9be1a9bdc714b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:28.211479 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:28.212157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-12c7844d-cffa-4c88-94de-77b5d0e3ea02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:28.213976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1383/2806] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:27 2022] DELETE /identity/v3/projects/068b6504c8db49c2a9be1a9bdc714b09 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:28.218939 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.219396 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.219507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.239485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:28.240692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:28.298236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1424/2807] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:28.306467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.306985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.307078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.326709 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:28.327910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:28.336515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1384/2808] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:28.341037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:28.351236 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96651dc-7c88-4c60-87c7-95757814b44f None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:28.355825 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:28.356359 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.356638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.356910 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.357579 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:25:28.357878 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:28.359470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.371175 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1425/2809] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:25:28.375430 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:28.384904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051792-21fe-4b3b-86ba-ed773b28a5dc None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:28.389772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:28.390387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.390692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.390955 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.394805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:28.394805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.485384 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1385/2810] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:28 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:28.490366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:28.501749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e7d4e-eb42-4d25-9172-4a98a69eda8f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:28.564608 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:28.565409 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.566266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.566266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.566860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:28.568758 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.671843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1426/2811] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:28 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:28.676060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:28.686774 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfbe93-d140-4075-9d94-988812ebb409 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:28.691690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:28.692824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.693147 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.693427 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.694079 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:28.695726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.706482 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1386/2812] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:28.711463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:28.718149 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:28.722080 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00101d24-eb02-4af1-86bf-c06805b8ca2e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:28.727328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932d17-f682-45e9-8fd7-4df7047a144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:28.727912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932d17-f682-45e9-8fd7-4df7047a144e admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.728327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932d17-f682-45e9-8fd7-4df7047a144e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.728545 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932d17-f682-45e9-8fd7-4df7047a144e admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.729179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f932d17-f682-45e9-8fd7-4df7047a144e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:28.730846 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f932d17-f682-45e9-8fd7-4df7047a144e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.742355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1427/2813] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:28.754072 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:28.766396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfd445-4dcb-466d-95c1-7b325e099cd5 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:28.772097 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:28.772768 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.773092 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.784136 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] PATH_INFO: `/v3/projects/d6597748b69946c8be609320226e3771/users/3d2fc567e0fc48779f1b4ac326b91062/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.793704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6597748b69946c8be609320226e3771, user_id=3d2fc567e0fc48779f1b4ac326b91062, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:28.796506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:28.892806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1387/2814] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:28 2022] PUT /identity/v3/projects/d6597748b69946c8be609320226e3771/users/3d2fc567e0fc48779f1b4ac326b91062/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:28.904217 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:28.904505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:28.904781 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:28.939350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] MFA Rules not processed for user `3d2fc567e0fc48779f1b4ac326b91062`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:28.940509 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:29.015230 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1428/2815] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:29.026606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:29.029135 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:29.045567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:29.102043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75061a4-be93-4c6b-afd3-586de14e82d7 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:29.110945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a27e7b-f7ea-45df-aad2-33faf6c7c286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:29.111585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27e7b-f7ea-45df-aad2-33faf6c7c286 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:29.111866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27e7b-f7ea-45df-aad2-33faf6c7c286 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:29.112197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27e7b-f7ea-45df-aad2-33faf6c7c286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:29.123145 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a27e7b-f7ea-45df-aad2-33faf6c7c286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:29.127436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a27e7b-f7ea-45df-aad2-33faf6c7c286 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:29.134939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1388/2816] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:39.012173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=35 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:39.200028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=20 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:40.555143 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:40.616995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0c59-d7d2-4487-ad2d-449215d1bd1e None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:40.621507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:40.622137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:40.622424 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:40.622704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] PATH_INFO: `/v3/users/3d2fc567e0fc48779f1b4ac326b91062` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:40.623813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2fc567e0fc48779f1b4ac326b91062)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:40.625806 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:40.858047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2fc567e0fc48779f1b4ac326b91062'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:40.858628 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2fc567e0fc48779f1b4ac326b91062'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:40.866108 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2fc567e0fc48779f1b4ac326b91062'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:40.985016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2fc567e0fc48779f1b4ac326b91062'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.002631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2fc567e0fc48779f1b4ac326b91062'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.010420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1429/2817] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:40 2022] DELETE /identity/v3/users/3d2fc567e0fc48779f1b4ac326b91062 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:41.015099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:41.015673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:41.015673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:41.034780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:41.035989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:41.097473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1389/2818] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:41.107382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:41.108915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:41.172837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43827-a217-479a-9136-b9d19c9eaee3 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:41.176474 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:41.177639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:41.177927 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:41.178207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:41.187242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:41.188678 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:41.198833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1430/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:41.636118 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:41.637745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:41.652637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e7e84-318b-4a7e-aad6-93d90a756610 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:41.658347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:41.659113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:41.659245 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:41.659519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] PATH_INFO: `/v3/projects/d6597748b69946c8be609320226e3771` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:41.660649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6597748b69946c8be609320226e3771)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:41.663122 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:41.769108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6597748b69946c8be609320226e3771', 'request_id': 'req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.775821 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6597748b69946c8be609320226e3771', 'request_id': 'req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.781800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6597748b69946c8be609320226e3771', 'request_id': 'req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.861113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] The token cache is being invalidate because project d6597748b69946c8be609320226e3771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:41.861410 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.862039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:41.863545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1390/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:41 2022] DELETE /identity/v3/projects/d6597748b69946c8be609320226e3771 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:51.194721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:51.857823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:13.553725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:13.562636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1124204-b68f-436b-9216-a65023692ab8 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:13.612642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:13.613313 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:13.613646 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:13.613879 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:13.615648 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:13.682856 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:13.684314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:13.694410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1431/2821] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:14.900637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:14.902390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:14.993181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a6aea-8249-4fd9-b382-5c0b9aebfc29 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:14.998713 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:14.999347 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:14.999632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:14.999916 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:15.001690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:15.015413 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:15.017038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:15.028611 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1391/2822] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:15.090822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:15.093155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:15.180266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba5958-27dc-42f9-a30d-1284ad8649ec service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:15.185940 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:15.186562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:15.187317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:15.187317 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:15.188876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:15.202452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:15.204215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:15.216584 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1432/2823] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:20.481064 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:20.482532 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:20.494736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed123f-d040-4a4d-b549-f284fbd94a5a service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:20.498722 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:20.499401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:20.499692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:20.499976 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:20.501769 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:20.573134 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:20.574588 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:20.584640 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1392/2824] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:24.488726 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:24.508250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b6f6-936c-4fd8-8258-0d0a4b53f4ac service placement] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:24.518404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:24.519496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:24.519979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:24.520446 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:24.525768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:24.538877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:24.540498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:24.553244 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1433/2825] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:28.398001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:28.410917 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc58a-8ad2-4cf8-85fb-8dd2387f1946 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:28.416673 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:28.417546 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:28.417835 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:28.418113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:28.419850 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:28.432506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:28.434113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:28.444708 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1393/2826] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:28.570574 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:28.572017 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:28.587114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950b966-4dd6-4ba0-9f19-13a416f8b75f service placement] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:28.592074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:28.592746 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:28.593066 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:28.593350 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] PATH_INFO: `/v3/users/6b90f274167943498168b681f173a7d3` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:28.594515 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b90f274167943498168b681f173a7d3)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:28.596438 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:28.708162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:28.831018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b90f274167943498168b681f173a7d3'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:28.831681 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b90f274167943498168b681f173a7d3'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:28.838908 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b90f274167943498168b681f173a7d3'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:28.919769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b90f274167943498168b681f173a7d3'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:28.933120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b90f274167943498168b681f173a7d3'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:28.939047 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1434/2827] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:27:28 2022] DELETE /identity/v3/users/6b90f274167943498168b681f173a7d3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:27:29.227956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:29.238897 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3e1be-4863-4aee-9111-9c64459a77e3 service placement] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:29.306758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:29.307555 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.307967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.308343 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] PATH_INFO: `/v3/projects/85ec83686a094c32b0484fff088fbe3f` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.309635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ec83686a094c32b0484fff088fbe3f)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:29.311758 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:29.320704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=100 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:29.577043 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ec83686a094c32b0484fff088fbe3f', 'request_id': 'req-31a9112b-2f33-44de-86dd-4d29cb8e833c'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:29.583903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ec83686a094c32b0484fff088fbe3f', 'request_id': 'req-31a9112b-2f33-44de-86dd-4d29cb8e833c'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:29.589787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ec83686a094c32b0484fff088fbe3f', 'request_id': 'req-31a9112b-2f33-44de-86dd-4d29cb8e833c'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:29.736127 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] The token cache is being invalidate because project 85ec83686a094c32b0484fff088fbe3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:27:29.736422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:29.737106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:29.738604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1394/2828] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:27:29 2022] DELETE /identity/v3/projects/85ec83686a094c32b0484fff088fbe3f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:27:29.745590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:29.745590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:29.759876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645abedc-bbbe-4cf1-8d6d-36238e357054 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:29.824126 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:29.824833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.825154 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.825461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] PATH_INFO: `/v3/users/18adf7fcfdc54cb38906e74791be9745` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.826609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18adf7fcfdc54cb38906e74791be9745)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:29.829314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:30.041055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18adf7fcfdc54cb38906e74791be9745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.041742 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18adf7fcfdc54cb38906e74791be9745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.049094 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18adf7fcfdc54cb38906e74791be9745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.119689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18adf7fcfdc54cb38906e74791be9745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.133578 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-cd34cecb-3342-414e-946f-bffd8051b757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18adf7fcfdc54cb38906e74791be9745'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.140187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1435/2829] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:27:29 2022] DELETE /identity/v3/users/18adf7fcfdc54cb38906e74791be9745 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:27:30.413519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:30.423458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:30.439070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9112b-2f33-44de-86dd-4d29cb8e833c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:30.501575 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:30.502248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:30.502534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:30.502813 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] PATH_INFO: `/v3/projects/61b14823e48048ea88c8cc0d13db9b20` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:30.504503 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b14823e48048ea88c8cc0d13db9b20)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:30.507610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:30.629894 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b14823e48048ea88c8cc0d13db9b20', 'request_id': 'req-5616125b-6385-4096-acc9-f88a1f331720'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.637256 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b14823e48048ea88c8cc0d13db9b20', 'request_id': 'req-5616125b-6385-4096-acc9-f88a1f331720'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.643106 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b14823e48048ea88c8cc0d13db9b20', 'request_id': 'req-5616125b-6385-4096-acc9-f88a1f331720'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.714700 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] The token cache is being invalidate because project 61b14823e48048ea88c8cc0d13db9b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:27:30.715029 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.715678 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:27:30.717206 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1395/2830] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:27:30 2022] DELETE /identity/v3/projects/61b14823e48048ea88c8cc0d13db9b20 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:27:40.136697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=16,keystone:SELECT=72,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:40.711025 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:43.834024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:28:43.834590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:28:43.834590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:28:43.855164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] MFA Rules not processed for user `259e4773318f4ef193ddfeaf15eaa6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:28:43.856382 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:28:43.912710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1436/2831] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:28:44.230337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:28:44.232165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:28:44.290180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616125b-6385-4096-acc9-f88a1f331720 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:28:44.294242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:28:44.294956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:28:44.295337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:28:44.295723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:28:44.298204 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:28:44.307846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:28:44.309300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:28:44.318275 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1396/2832] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:28:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:28:53.905970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=25 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:54.314540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=26 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:14.806270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:14.807637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:14.821614 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf16f-4b3e-4f21-89ed-09e07e0ea4f8 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:14.825557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:14.826191 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:14.826470 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:14.826744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:14.828461 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:14.838508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:14.839936 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:14.852511 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1437/2833] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:19.996119 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:19.998078 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.085819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bc3f-8904-432f-8c8f-70b245fa4e9f service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.092224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.092838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.093157 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.093439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.095447 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.109866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.111635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.122422 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1397/2834] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:21.847178 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:21.849135 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.906472 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258464-e29d-44ca-b84e-0e38d81b85c2 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:21.910638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:21.911246 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:21.911529 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:21.911810 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.913594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.927570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:21.929040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:21.940321 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1438/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:26.808964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.818488 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c9e5-a0ae-4c0d-be55-d2132bf7c3ba service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.822449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.823054 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.823332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.823603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.825526 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.840224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.841948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.853735 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1398/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:31.935160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=32 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:36.848015 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=40 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:45.964979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.976289 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25895bb-de14-4f1e-ae5d-8cd333045ea8 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:45.981520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:45.982121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.982401 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.982702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.984408 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:46.047332 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.048786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.059632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1439/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:49.619587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:49.621099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:49.637864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fe6ce-3b19-4d37-a299-5e71952ace88 service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:49.642537 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:49.643194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:49.643498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:49.643772 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] PATH_INFO: `/v3/users/259e4773318f4ef193ddfeaf15eaa6ce` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:49.644885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=259e4773318f4ef193ddfeaf15eaa6ce)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:49.646837 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:49.841419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259e4773318f4ef193ddfeaf15eaa6ce'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:49.849585 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259e4773318f4ef193ddfeaf15eaa6ce'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:49.850302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259e4773318f4ef193ddfeaf15eaa6ce'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:49.851205 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259e4773318f4ef193ddfeaf15eaa6ce'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:49.932972 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-6de61ec1-0fa2-4a90-9172-ddbb80ad4f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259e4773318f4ef193ddfeaf15eaa6ce'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:49.951477 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1399/2838] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:49 2022] DELETE /identity/v3/users/259e4773318f4ef193ddfeaf15eaa6ce => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:50.216043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:50.229688 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3141e2-03c3-4eb1-9626-ca5fb5502b8c service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:50.288288 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:50.288919 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.289233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.289517 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] PATH_INFO: `/v3/projects/832bb2bb73bf4a94bb41ab41682b1c34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.290876 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832bb2bb73bf4a94bb41ab41682b1c34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:50.292793 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:50.395487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832bb2bb73bf4a94bb41ab41682b1c34', 'request_id': 'req-ffb527ad-7b31-4c17-af25-a92f732cdf65'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:50.474376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832bb2bb73bf4a94bb41ab41682b1c34', 'request_id': 'req-ffb527ad-7b31-4c17-af25-a92f732cdf65'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:50.481338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832bb2bb73bf4a94bb41ab41682b1c34', 'request_id': 'req-ffb527ad-7b31-4c17-af25-a92f732cdf65'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:50.491911 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] The token cache is being invalidate because project 832bb2bb73bf4a94bb41ab41682b1c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:50.492204 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:50.493496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffb527ad-7b31-4c17-af25-a92f732cdf65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:50.495033 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1440/2839] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:50 2022] DELETE /identity/v3/projects/832bb2bb73bf4a94bb41ab41682b1c34 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:50.499902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.500194 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.500587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.522260 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:50.523469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:50.590249 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1400/2840] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:50.598348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.598638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.598918 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.619366 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:50.620596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:50.628668 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1441/2841] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:50.633022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:50.643504 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f215a69-254b-48bb-9ce3-5940f9387228 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:50.648172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:50.648779 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.649300 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.649571 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.650210 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:50.650514 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:50.652151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:50.663999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1401/2842] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:50.668353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:50.677557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c278d7e-039d-4be9-a650-105663d36902 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:50.683034 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:50.683631 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.683915 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.684194 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.684826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:50.686794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:50.704557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:50.796597 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1442/2843] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:50 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:50.800846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:50.811661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba0385-75f6-4be0-b590-5948f1114777 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:50.873203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:50.873901 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.874184 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.874458 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.875095 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:50.877026 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:50.885086 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:50.956315 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1402/2844] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:50 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:50.960498 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:50.973270 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435ef1-fd24-4d96-8189-77ffa6444a4f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:50.978881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:50.979488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:50.979777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:50.980057 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:50.980705 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:50.982406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:50.992527 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1443/2845] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:50.997253 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:51.007131 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7a7e5-d6c6-4c1a-9e5e-d96ebacd5a04 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:51.012001 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3e889-ed61-47bb-91b5-4f65c7f86d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:51.012602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e889-ed61-47bb-91b5-4f65c7f86d3b admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.012888 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e889-ed61-47bb-91b5-4f65c7f86d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.013201 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e889-ed61-47bb-91b5-4f65c7f86d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.013844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3e889-ed61-47bb-91b5-4f65c7f86d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:51.015443 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3e889-ed61-47bb-91b5-4f65c7f86d3b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:51.025922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1403/2846] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:51.036983 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:51.047821 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c18b-8620-4de7-a881-b2ccecdc7046 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:51.052734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:51.053420 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.053706 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.053986 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] PATH_INFO: `/v3/projects/1bf3621208cf4e03a19bca06cca150ce/users/6424a1c29831426b8c5794c8ecd09d15/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.069179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf3621208cf4e03a19bca06cca150ce, user_id=6424a1c29831426b8c5794c8ecd09d15, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:51.074222 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:51.168519 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1444/2847] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:51 2022] PUT /identity/v3/projects/1bf3621208cf4e03a19bca06cca150ce/users/6424a1c29831426b8c5794c8ecd09d15/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:51.180012 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.180306 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.180592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.210687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] MFA Rules not processed for user `6424a1c29831426b8c5794c8ecd09d15`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:51.213961 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:51.282870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1404/2848] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:51.294843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:51.296556 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:51.375393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e03d9-deef-42cb-b20d-6d66635fc662 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:51.375637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098aa89-63c2-4ad9-a565-ad284758cf29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:51.377926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098aa89-63c2-4ad9-a565-ad284758cf29 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.377926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098aa89-63c2-4ad9-a565-ad284758cf29 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.377926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098aa89-63c2-4ad9-a565-ad284758cf29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.385055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098aa89-63c2-4ad9-a565-ad284758cf29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:51.386651 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098aa89-63c2-4ad9-a565-ad284758cf29 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:51.395452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1445/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:54.838390 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.899933 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6e3b6-f063-4f7f-bfc7-b7249c9e2a81 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.904527 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.905189 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.905471 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.905745 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] PATH_INFO: `/v3/users/6424a1c29831426b8c5794c8ecd09d15` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.906872 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6424a1c29831426b8c5794c8ecd09d15)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.908787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.081706 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6424a1c29831426b8c5794c8ecd09d15'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:55.088452 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6424a1c29831426b8c5794c8ecd09d15'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:55.089155 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6424a1c29831426b8c5794c8ecd09d15'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:55.089783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6424a1c29831426b8c5794c8ecd09d15'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:55.160923 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6424a1c29831426b8c5794c8ecd09d15'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:55.166676 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:55.180005 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1405/2850] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:54 2022] DELETE /identity/v3/users/6424a1c29831426b8c5794c8ecd09d15 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:55.184533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.185633 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.185938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.204835 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:55.206077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:55.265844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1446/2851] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:55.275525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.277046 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:55.336610 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2c9b2-d308-4da7-8f46-2bc0d400082a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.340187 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afcf31-e796-40c4-bd58-c9009e6a2367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.341717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcf31-e796-40c4-bd58-c9009e6a2367 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.341854 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcf31-e796-40c4-bd58-c9009e6a2367 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.342219 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcf31-e796-40c4-bd58-c9009e6a2367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.351442 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcf31-e796-40c4-bd58-c9009e6a2367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.352865 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcf31-e796-40c4-bd58-c9009e6a2367 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.362907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1406/2852] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:55.768956 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.770510 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:55.783814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3894-8913-4ac4-a84a-3217b9d7a512 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.788704 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.789368 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.792295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.792295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] PATH_INFO: `/v3/projects/1bf3621208cf4e03a19bca06cca150ce` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.792295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf3621208cf4e03a19bca06cca150ce)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.793140 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.892612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:55.898488 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf3621208cf4e03a19bca06cca150ce', 'request_id': 'req-e84af660-3a5e-4a9f-b209-1fb34d818415'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:56.086585 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf3621208cf4e03a19bca06cca150ce', 'request_id': 'req-e84af660-3a5e-4a9f-b209-1fb34d818415'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:56.093875 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf3621208cf4e03a19bca06cca150ce', 'request_id': 'req-e84af660-3a5e-4a9f-b209-1fb34d818415'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:56.104493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] The token cache is being invalidate because project 1bf3621208cf4e03a19bca06cca150ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:56.104786 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:56.105434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-e84af660-3a5e-4a9f-b209-1fb34d818415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:56.106899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1447/2853] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:55 2022] DELETE /identity/v3/projects/1bf3621208cf4e03a19bca06cca150ce => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:56.112038 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.112536 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.112637 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.134873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:56.136082 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:56.198919 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1407/2854] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:56.207576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.208069 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.208192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.228219 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:56.229475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:56.237824 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1448/2855] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:56.242087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.256500 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4513e-2868-4cf3-b48d-ffb66eedf68d None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.261264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.261879 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.262165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.262441 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.264178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:56.264540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.266208 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.279567 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1408/2856] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:56.284162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.295308 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf004ac-b5e9-4684-8e9a-dad094c7d2a9 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.300457 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.301105 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.301389 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.301667 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.302315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.304406 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.384843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1449/2857] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:56 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:56.390091 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.400800 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb859-70b0-4284-9a6a-99d6c7287584 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.457658 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.458175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.458459 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.458739 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.459395 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.461340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.561734 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1409/2858] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:56 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:56.565881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.576671 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e86af5-0313-4a26-ab1d-f3b3e149c386 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.581327 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.581914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.582195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.582484 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.583190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.584779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.608448 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1450/2859] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:56.612519 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.623956 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0ae8a-14e6-4d17-8a3b-1cbf679abb65 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.628641 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4e425-bef1-491d-9293-9a2ce9a1c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.629289 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4e425-bef1-491d-9293-9a2ce9a1c590 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.629579 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4e425-bef1-491d-9293-9a2ce9a1c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.629864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4e425-bef1-491d-9293-9a2ce9a1c590 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.630515 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4e425-bef1-491d-9293-9a2ce9a1c590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.632143 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4e425-bef1-491d-9293-9a2ce9a1c590 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.633498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:56.644224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1410/2860] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:56.654822 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.665161 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11088b6-f9ef-4e71-bfa9-279f908ff909 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.670555 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.671314 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.671645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.671914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] PATH_INFO: `/v3/projects/3d01e05e893e4a3ab24dc287d3a406bf/users/ac8e88ba3f7841fb873b8fd4cbb2fe02/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.688059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d01e05e893e4a3ab24dc287d3a406bf, user_id=ac8e88ba3f7841fb873b8fd4cbb2fe02, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.691184 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.796077 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1451/2861] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:56 2022] PUT /identity/v3/projects/3d01e05e893e4a3ab24dc287d3a406bf/users/ac8e88ba3f7841fb873b8fd4cbb2fe02/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:56.806661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.806952 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.807242 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.836496 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] MFA Rules not processed for user `ac8e88ba3f7841fb873b8fd4cbb2fe02`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:56.837787 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:56.902487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1411/2862] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:56.907689 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:56.973725 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682225d-747d-4830-9ba8-c47a00d57036 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.978478 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.979085 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.979374 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.979658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.980309 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.982826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.180054 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1452/2863] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:56 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:57.184068 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.195234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b086-5f74-4fa5-9fa6-eaa6ed7d014c None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.253008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.253632 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.253920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.254843 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.255502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.257456 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.365858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1412/2864] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:57 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:57.369992 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.381284 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd711129-2dea-496a-9ce8-139d0efd8363 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.385946 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.386541 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.386823 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.387098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.387732 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.389487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.400018 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1453/2865] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:57.404301 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.414534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0882-d3f0-496f-80cb-edf1313e8dd6 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.419903 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.420517 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.420805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.421116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] PATH_INFO: `/v3/projects/e278e9ecc5c4471ca3cc340d2d7cab26/users/cfe360f8c0654b25ab3af3496570ac4a/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.438055 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e278e9ecc5c4471ca3cc340d2d7cab26, user_id=cfe360f8c0654b25ab3af3496570ac4a, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.440907 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.549451 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1413/2866] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:57 2022] PUT /identity/v3/projects/e278e9ecc5c4471ca3cc340d2d7cab26/users/cfe360f8c0654b25ab3af3496570ac4a/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:57.553477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.564158 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f023988-6312-43c2-852f-5ccdf320a72b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.602195 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:57.620277 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4eba0-b609-49a9-aa41-d60520001584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.620888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4eba0-b609-49a9-aa41-d60520001584 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.621210 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4eba0-b609-49a9-aa41-d60520001584 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.621490 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4eba0-b609-49a9-aa41-d60520001584 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.622188 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4eba0-b609-49a9-aa41-d60520001584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.626538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4eba0-b609-49a9-aa41-d60520001584 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.641333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1454/2867] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:57.645717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.656626 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9135cb-1d2d-4f06-b1c7-08afd8b28742 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.661325 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.661977 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.662298 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.662605 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] PATH_INFO: `/v3/projects/e278e9ecc5c4471ca3cc340d2d7cab26/users/cfe360f8c0654b25ab3af3496570ac4a/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.664539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e278e9ecc5c4471ca3cc340d2d7cab26, user_id=cfe360f8c0654b25ab3af3496570ac4a, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.667220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.677809 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1414/2868] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:57 2022] PUT /identity/v3/projects/e278e9ecc5c4471ca3cc340d2d7cab26/users/cfe360f8c0654b25ab3af3496570ac4a/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:57.690593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.690815 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.691099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.720972 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] MFA Rules not processed for user `cfe360f8c0654b25ab3af3496570ac4a`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:57.723037 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:57.791123 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1455/2869] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:57.802914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.804604 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:57.847859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:57.863587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ec18e-10ec-470a-a34a-f4bce0396755 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.867377 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157281-0adc-4282-a4f4-841bb069e85b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.867996 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157281-0adc-4282-a4f4-841bb069e85b service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.868279 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157281-0adc-4282-a4f4-841bb069e85b service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.868557 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157281-0adc-4282-a4f4-841bb069e85b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.878834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10157281-0adc-4282-a4f4-841bb069e85b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.880248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10157281-0adc-4282-a4f4-841bb069e85b service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.890726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1415/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:00.857841 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:00.919410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a95d-e058-41ea-a48e-53a7c63b4549 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:00.924485 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:00.925141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:00.925426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:00.925698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] PATH_INFO: `/v3/users/ac8e88ba3f7841fb873b8fd4cbb2fe02` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:00.926805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8e88ba3f7841fb873b8fd4cbb2fe02)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:00.928710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:01.194422 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8e88ba3f7841fb873b8fd4cbb2fe02'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:01.195130 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8e88ba3f7841fb873b8fd4cbb2fe02'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:01.202302 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8e88ba3f7841fb873b8fd4cbb2fe02'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:01.349789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8e88ba3f7841fb873b8fd4cbb2fe02'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:01.351226 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:01.364040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8e88ba3f7841fb873b8fd4cbb2fe02'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:01.369903 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1456/2871] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:00 2022] DELETE /identity/v3/users/ac8e88ba3f7841fb873b8fd4cbb2fe02 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:01.374670 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:01.375196 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:01.375340 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:01.399625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:01.400918 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:01.462481 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1416/2872] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:01.472607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:01.474036 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:01.531762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f56c01-0550-4adf-b6f0-e8159431ff4e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:01.535433 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:01.536043 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:01.536329 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:01.536607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:01.545573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:01.547109 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:01.556531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1457/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:01.967042 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:01.968833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:01.983782 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ed318-f820-487a-9eed-5b1f5e5e0c97 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:01.991291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:01.991929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:01.992203 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:01.992540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] PATH_INFO: `/v3/projects/3d01e05e893e4a3ab24dc287d3a406bf` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:01.993840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d01e05e893e4a3ab24dc287d3a406bf)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:01.995836 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:02.106948 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d01e05e893e4a3ab24dc287d3a406bf', 'request_id': 'req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.114177 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d01e05e893e4a3ab24dc287d3a406bf', 'request_id': 'req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.119979 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d01e05e893e4a3ab24dc287d3a406bf', 'request_id': 'req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.204572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] The token cache is being invalidate because project 3d01e05e893e4a3ab24dc287d3a406bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:02.204862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.205572 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.207080 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1417/2874] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:01 2022] DELETE /identity/v3/projects/3d01e05e893e4a3ab24dc287d3a406bf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:31:02.211106 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:02.221751 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2712-8519-44f7-ad10-819a5d5b5a12 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:02.278532 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:02.279162 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:02.279449 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:02.279730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] PATH_INFO: `/v3/users/cfe360f8c0654b25ab3af3496570ac4a` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:02.281410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe360f8c0654b25ab3af3496570ac4a)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:02.283348 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:02.469084 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe360f8c0654b25ab3af3496570ac4a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.469869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe360f8c0654b25ab3af3496570ac4a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.476862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe360f8c0654b25ab3af3496570ac4a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.560872 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe360f8c0654b25ab3af3496570ac4a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.573826 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-1fde1bdc-5907-4d3d-b821-a94e98f8abbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe360f8c0654b25ab3af3496570ac4a'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.580315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1458/2875] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:02 2022] DELETE /identity/v3/users/cfe360f8c0654b25ab3af3496570ac4a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:02.997401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:02.998968 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:03.013847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6727-da6c-4b4b-a900-3d1b2d4411ae admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.077178 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.077814 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.078094 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.078370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] PATH_INFO: `/v3/projects/e278e9ecc5c4471ca3cc340d2d7cab26` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.079866 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e278e9ecc5c4471ca3cc340d2d7cab26)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.081798 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.088337 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:03.206636 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e278e9ecc5c4471ca3cc340d2d7cab26', 'request_id': 'req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.212688 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e278e9ecc5c4471ca3cc340d2d7cab26', 'request_id': 'req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.218528 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e278e9ecc5c4471ca3cc340d2d7cab26', 'request_id': 'req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.320342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] The token cache is being invalidate because project e278e9ecc5c4471ca3cc340d2d7cab26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:03.320550 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.321214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f8a1517c-0be7-4ab2-8d61-1f1fa3d3b5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.322719 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1418/2876] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:02 2022] DELETE /identity/v3/projects/e278e9ecc5c4471ca3cc340d2d7cab26 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:03.327594 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.328049 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.328167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.336172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:03.349225 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:03.350442 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:03.410058 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1459/2877] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:03.418159 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.418580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.418958 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.440323 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:03.441587 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:03.449525 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1419/2878] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:03.453844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.463558 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50364-7302-4868-ada0-9578bc50f056 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.468402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.469060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.469877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.470136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] PATH_INFO: `/v3/domains` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.470784 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:03.471092 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.472692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.488146 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1460/2879] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:03.492643 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.502044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9073be6-30a8-4953-8db5-802941df5542 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.507113 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.507876 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.508161 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.508439 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.509198 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.511445 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.637060 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1420/2880] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:03 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:03.641151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.651566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ebd4-ef12-47b5-87d4-9c22200a605a admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.709638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.710249 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.710538 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.710820 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.711450 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.713419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.830912 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1461/2881] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:03 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:03.835218 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.846864 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41115f-b903-4960-8b46-c8e302fc5525 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.851612 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.852220 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.852502 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.852781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.853463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.855070 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.866153 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1421/2882] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:03.870452 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.880710 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3010-a171-408c-b9f9-802b01b8c83f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.885373 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf5c01-fe55-43b3-a187-1b3218602fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.885978 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf5c01-fe55-43b3-a187-1b3218602fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.886266 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf5c01-fe55-43b3-a187-1b3218602fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.886546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf5c01-fe55-43b3-a187-1b3218602fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.887248 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf5c01-fe55-43b3-a187-1b3218602fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.888798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf5c01-fe55-43b3-a187-1b3218602fd6 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.900296 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1462/2883] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:03.906003 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.917638 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba63a-302f-473d-9c31-753e0c7e5164 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.922506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.923158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.923440 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.923715 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] PATH_INFO: `/v3/projects/d85a027f523b4459b75cd4260e1f0a4f/users/1b7bf94a104a466885f79c76314e35d2/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.938939 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85a027f523b4459b75cd4260e1f0a4f, user_id=1b7bf94a104a466885f79c76314e35d2, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.941634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.075634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1422/2884] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:03 2022] PUT /identity/v3/projects/d85a027f523b4459b75cd4260e1f0a4f/users/1b7bf94a104a466885f79c76314e35d2/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.088187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.088480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.088764 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.126625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] MFA Rules not processed for user `1b7bf94a104a466885f79c76314e35d2`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:04.127869 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:04.192102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:04.197480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1463/2885] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:04.202098 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.274524 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5299e-7f05-4a9d-9101-9130b087576c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.275533 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.276152 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.276436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.276717 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] PATH_INFO: `/v3/projects` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.277401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.279322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.402362 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1423/2886] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:04 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:04.406581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.417590 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0778-ce1e-4c54-9fc8-a25c8a5dc0ef None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.474144 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.474662 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.474968 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.475242 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] PATH_INFO: `/v3/users` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.475865 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.477900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.561609 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1464/2887] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:04 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:04.565980 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.576649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c91a94-2dcd-4091-afaa-b342067711aa admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.583846 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.584751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.585261 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.585770 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.586805 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.589511 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.606116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1424/2888] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:04.610980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.621268 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b331b-4c7a-42e7-93dd-eb0f8d1b78ba admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.626632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.627339 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.627632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.627914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] PATH_INFO: `/v3/projects/68c5598c8db3478f88293af10cdf93d7/users/7c653d7435c146a6b4f7ef5c4ca7d97f/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.644685 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c5598c8db3478f88293af10cdf93d7, user_id=7c653d7435c146a6b4f7ef5c4ca7d97f, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.647387 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.727851 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1465/2889] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:04 2022] PUT /identity/v3/projects/68c5598c8db3478f88293af10cdf93d7/users/7c653d7435c146a6b4f7ef5c4ca7d97f/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.731751 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.738406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:04.742158 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88a47-4d0d-496b-ba04-9860bd72bfe8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.800002 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1e58-40a9-46f0-9cf5-275b0387c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.800619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1e58-40a9-46f0-9cf5-275b0387c62c admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.800899 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1e58-40a9-46f0-9cf5-275b0387c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.801506 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1e58-40a9-46f0-9cf5-275b0387c62c admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.802022 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1e58-40a9-46f0-9cf5-275b0387c62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.803453 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1e58-40a9-46f0-9cf5-275b0387c62c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.815299 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1425/2890] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:04.819750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.831121 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a7da4-b901-47b9-be64-1b21d3bc1c58 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.835890 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.836546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.836837 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.837151 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] PATH_INFO: `/v3/projects/68c5598c8db3478f88293af10cdf93d7/users/7c653d7435c146a6b4f7ef5c4ca7d97f/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.839117 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c5598c8db3478f88293af10cdf93d7, user_id=7c653d7435c146a6b4f7ef5c4ca7d97f, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.842216 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.854301 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1466/2891] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:04 2022] PUT /identity/v3/projects/68c5598c8db3478f88293af10cdf93d7/users/7c653d7435c146a6b4f7ef5c4ca7d97f/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.865295 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.865583 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.865862 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.894807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] MFA Rules not processed for user `7c653d7435c146a6b4f7ef5c4ca7d97f`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:04.896006 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:04.968580 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1426/2892] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:04.980259 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.982030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.043607 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb564-f327-439f-91e2-e789e62f2d17 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.047816 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf082-76e1-4dce-ad9a-e15b654d9c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.048437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf082-76e1-4dce-ad9a-e15b654d9c1a service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.048723 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf082-76e1-4dce-ad9a-e15b654d9c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.049040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf082-76e1-4dce-ad9a-e15b654d9c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.058250 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edf082-76e1-4dce-ad9a-e15b654d9c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.059693 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edf082-76e1-4dce-ad9a-e15b654d9c1a service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.070279 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1467/2893] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:05.139994 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.204425 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3a459-ec6b-404d-97ac-e7927a2610c9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.209396 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.210056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.210342 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.210621 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] PATH_INFO: `/v3/users/1b7bf94a104a466885f79c76314e35d2` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.211810 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7bf94a104a466885f79c76314e35d2)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.213808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.334361 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:05.443682 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7bf94a104a466885f79c76314e35d2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:05.450372 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7bf94a104a466885f79c76314e35d2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:05.451061 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7bf94a104a466885f79c76314e35d2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:05.451674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7bf94a104a466885f79c76314e35d2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:05.532949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7bf94a104a466885f79c76314e35d2'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:05.552789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1427/2894] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:05 2022] DELETE /identity/v3/users/1b7bf94a104a466885f79c76314e35d2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:05.557428 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.557928 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.558032 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.577354 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:05.578636 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.629233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:05.641777 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1468/2895] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:05.651645 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.653059 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.719724 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6b197-7350-479e-a0fd-d475e540192b admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.723421 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.724035 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.724327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.724609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.734190 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.736286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.746176 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1428/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:06.214813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:06.226982 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:06.229833 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319f97f-238d-4d50-a442-ecc49396285b None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:06.235576 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:06.236228 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:06.236520 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:06.237173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] PATH_INFO: `/v3/projects/d85a027f523b4459b75cd4260e1f0a4f` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:06.238009 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85a027f523b4459b75cd4260e1f0a4f)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:06.239970 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:06.374376 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85a027f523b4459b75cd4260e1f0a4f', 'request_id': 'req-78defa33-72d0-42b4-a970-b5d01df192a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.457101 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85a027f523b4459b75cd4260e1f0a4f', 'request_id': 'req-78defa33-72d0-42b4-a970-b5d01df192a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.463952 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85a027f523b4459b75cd4260e1f0a4f', 'request_id': 'req-78defa33-72d0-42b4-a970-b5d01df192a5'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.475818 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] The token cache is being invalidate because project d85a027f523b4459b75cd4260e1f0a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:06.476107 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.476794 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.478334 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1469/2897] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:06 2022] DELETE /identity/v3/projects/d85a027f523b4459b75cd4260e1f0a4f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:06.482404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:06.492404 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fac208-6abc-4667-81e7-99fd1494b804 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:06.551288 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:06.551922 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:06.552209 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:06.552493 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] PATH_INFO: `/v3/users/7c653d7435c146a6b4f7ef5c4ca7d97f` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:06.553634 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c653d7435c146a6b4f7ef5c4ca7d97f)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:06.555563 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:06.758341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c653d7435c146a6b4f7ef5c4ca7d97f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.760409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:06.765701 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c653d7435c146a6b4f7ef5c4ca7d97f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.766389 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c653d7435c146a6b4f7ef5c4ca7d97f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.769714 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c653d7435c146a6b4f7ef5c4ca7d97f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.885480 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-91aed324-c31f-44c5-a686-9b5a8b6a4a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c653d7435c146a6b4f7ef5c4ca7d97f'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:06.903353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1429/2898] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:06 2022] DELETE /identity/v3/users/7c653d7435c146a6b4f7ef5c4ca7d97f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:07.379593 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:07.381088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:07.400779 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78defa33-72d0-42b4-a970-b5d01df192a5 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:07.451843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:07.452477 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:07.452762 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:07.453073 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] PATH_INFO: `/v3/projects/68c5598c8db3478f88293af10cdf93d7` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:07.454223 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c5598c8db3478f88293af10cdf93d7)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:07.456293 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:07.603263 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c5598c8db3478f88293af10cdf93d7', 'request_id': 'req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:07.715072 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c5598c8db3478f88293af10cdf93d7', 'request_id': 'req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:07.722994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c5598c8db3478f88293af10cdf93d7', 'request_id': 'req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:07.734828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] The token cache is being invalidate because project 68c5598c8db3478f88293af10cdf93d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:07.734828 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:07.735440 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-4e1eadd7-d472-4b20-8daa-ad7a9966dfb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:07.737209 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1470/2899] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:07 2022] DELETE /identity/v3/projects/68c5598c8db3478f88293af10cdf93d7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:07.743116 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:07.747188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:07.747188 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:07.764753 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:07.766103 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:07.826870 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1430/2900] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:07.835573 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:07.835868 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:07.836157 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:07.853945 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:07.860419 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:07.862141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:07.870402 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1471/2901] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:07.874791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:07.884680 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660233a7-b878-446f-ab5b-513106ad6b6a None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:07.896044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:07.896044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:07.896044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:07.896044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:07.896464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:07.896464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:07.896464 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:07.905967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1431/2902] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:07.911012 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:07.920300 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae767b-c723-460d-93b1-66e698f2b258 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:07.925213 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:07.925814 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:07.926093 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:07.926365 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:07.927000 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:07.928896 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:08.048320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1472/2903] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:07 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:08.052920 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:08.064467 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7310-3c1a-407a-9130-b59ddc94039a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:08.130910 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:08.131885 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:08.132330 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:08.132791 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:08.133624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:08.135707 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:08.253473 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1432/2904] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:08 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:08.257728 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:08.268731 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43261b8b-c3f8-4519-8b9e-0f36613f13af admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:08.273638 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:08.273929 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:08.274212 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:08.274492 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:08.275137 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:08.276768 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:08.287658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1473/2905] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:31:08.291834 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:08.303426 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a8a07-0c6c-4f02-b0ce-974cff32e8ae admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:08.308314 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba823-7fba-4ec6-9c67-c4212beb698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:08.308929 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba823-7fba-4ec6-9c67-c4212beb698c admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:08.309264 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba823-7fba-4ec6-9c67-c4212beb698c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:08.309543 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba823-7fba-4ec6-9c67-c4212beb698c admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:08.310207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba823-7fba-4ec6-9c67-c4212beb698c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:08.311806 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba823-7fba-4ec6-9c67-c4212beb698c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:08.326089 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1433/2906] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:08.330434 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:08.340605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726626e-db3f-4a2e-98b3-e5e20f041f68 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:08.345407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:08.346055 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:08.346337 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:08.346615 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] PATH_INFO: `/v3/projects/48de441dc89747349096ca2488a521e8/users/393dccd25cd34168b4b6cd1b496c8846/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:08.362605 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48de441dc89747349096ca2488a521e8, user_id=393dccd25cd34168b4b6cd1b496c8846, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:08.365426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:08.481038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1474/2907] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:08 2022] PUT /identity/v3/projects/48de441dc89747349096ca2488a521e8/users/393dccd25cd34168b4b6cd1b496c8846/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:08.486951 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388e04-36bf-43a7-97a1-db990cd7cb7d None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:08.487235 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388e04-36bf-43a7-97a1-db990cd7cb7d None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:08.487513 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388e04-36bf-43a7-97a1-db990cd7cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:08.507461 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-80388e04-36bf-43a7-97a1-db990cd7cb7d None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:08.508081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-80388e04-36bf-43a7-97a1-db990cd7cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:08.538749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:08.572902 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1434/2908] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:08.583877 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:08.585637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:08.646459 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963aa58-406e-41f8-8676-459bdffea55f admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:08.650160 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:08.650773 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:08.651059 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:08.651341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:08.661522 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:08.668412 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:08.673169 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1475/2909] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:10.090691 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.091549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.091704 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.120744 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] MFA Rules not processed for user `393dccd25cd34168b4b6cd1b496c8846`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:10.122126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:10.195457 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1435/2910] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:10.200098 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:10.210048 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980af92d-6398-49cd-98bd-2aa4ccb14d57 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:10.214642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:10.215227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.215506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.215776 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.216661 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:10.218570 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:10.346102 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1476/2911] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:10 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:10.351199 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:10.363039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43522df6-0cf9-4a2b-b220-ebf47772dffa None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:10.420213 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:10.420848 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.421175 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.421539 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.422180 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:10.424698 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:10.538849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1436/2912] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:10 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:31:10.542769 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:10.553914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314642-5251-4c66-b88c-cec816be0a48 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:10.558637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:10.559355 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.559642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.559917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.560557 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:10.562333 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:10.572926 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1477/2913] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:10.576989 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:10.587913 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfc04-7f76-499d-b710-4e3060b5f607 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:10.593039 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:10.593692 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.593978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.594341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] PATH_INFO: `/v3/projects/efb20de4ba8d4fccb8c73332933d849f/users/c389a04c17ce45c0ac16a8c40f7e3392/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.610674 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb20de4ba8d4fccb8c73332933d849f, user_id=c389a04c17ce45c0ac16a8c40f7e3392, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:10.613304 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:10.686964 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1437/2914] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:10 2022] PUT /identity/v3/projects/efb20de4ba8d4fccb8c73332933d849f/users/c389a04c17ce45c0ac16a8c40f7e3392/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:10.690994 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:10.700921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce97885-e5c9-48e3-b930-18487026df1e admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:10.757445 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf76d06-263f-471e-81b6-2a0786b9382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:10.758056 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf76d06-263f-471e-81b6-2a0786b9382d admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.758349 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf76d06-263f-471e-81b6-2a0786b9382d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.758623 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf76d06-263f-471e-81b6-2a0786b9382d admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.759269 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf76d06-263f-471e-81b6-2a0786b9382d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:10.760871 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf76d06-263f-471e-81b6-2a0786b9382d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:10.771805 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1478/2915] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:10.777811 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:10.789239 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecf166-cc8a-4e5e-bf32-e50cce87d84c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:10.793875 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ad86-b653-48c4-b332-802e62348f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:10.794518 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ad86-b653-48c4-b332-802e62348f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:10.794802 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ad86-b653-48c4-b332-802e62348f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:10.795081 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ad86-b653-48c4-b332-802e62348f1b admin admin] PATH_INFO: `/v3/projects/efb20de4ba8d4fccb8c73332933d849f/users/c389a04c17ce45c0ac16a8c40f7e3392/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:10.797051 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0ad86-b653-48c4-b332-802e62348f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb20de4ba8d4fccb8c73332933d849f, user_id=c389a04c17ce45c0ac16a8c40f7e3392, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:10.800308 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0ad86-b653-48c4-b332-802e62348f1b admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:10.810449 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1438/2916] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:10 2022] PUT /identity/v3/projects/efb20de4ba8d4fccb8c73332933d849f/users/c389a04c17ce45c0ac16a8c40f7e3392/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:12.601480 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:12.602016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:12.602016 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:12.621639 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:12.632415 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] MFA Rules not processed for user `c389a04c17ce45c0ac16a8c40f7e3392`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:12.633388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:12.707074 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1479/2917] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:12.717909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:12.718429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:12.718549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:12.737975 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] MFA Rules not processed for user `393dccd25cd34168b4b6cd1b496c8846`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:12.739112 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:12.748252 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:12.795858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1439/2918] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:12.809201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:12.810750 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:12.886142 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8a3b6-9f49-43eb-a211-41b2d4c9839a None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:12.892192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:12.896765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:12.896765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:12.896765 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:12.901247 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:12.902843 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:12.911785 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1480/2919] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:13.146327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:13.147748 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:13.205863 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f2d27-4f16-40e8-aa69-926ed7d15dc6 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:13.209573 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:13.210197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:13.210486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:13.210766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:13.212545 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:13.224570 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:13.226071 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:13.234896 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1440/2920] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:13.721531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:13.723749 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:13.810504 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9fa03-d303-4ae4-a673-3435ad1cf334 service nova] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:13.815888 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:13.816489 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:13.816772 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:13.817088 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:13.819320 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:13.832893 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:13.834625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:13.846173 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1481/2921] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:23.230953 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=44 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:23.840692 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=96 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:24.667151 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:24.677823 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c1705-f351-49e6-a265-12b121a17039 service neutron] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:24.683967 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3083107d17b4596b7b858df7fc50147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:24.684596 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:24.684884 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:24.685214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:24.687007 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:24.700489 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:24.702186 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:24.713207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1441/2922] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:30.411295 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:30.412699 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:30.480189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc799f4-7a32-40bc-b6ec-88bfd3f744a9 service placement] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:30.484848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:30.485980 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.488172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.488172 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.498019 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:30.499506 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:30.513744 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1482/2923] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:34.708624 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:40.508364 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=26 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:54.378609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:54.445099 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3641-0eb3-477a-84a8-a0e21e52686a service nova] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:54.450370 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:54.450995 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:54.451273 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:54.451544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] PATH_INFO: `/v3/users/393dccd25cd34168b4b6cd1b496c8846` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:54.452655 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] RBAC: Authorizing `identity:delete_user(user_id=393dccd25cd34168b4b6cd1b496c8846)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:54.454600 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:54.710202 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393dccd25cd34168b4b6cd1b496c8846'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.717540 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393dccd25cd34168b4b6cd1b496c8846'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.718236 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393dccd25cd34168b4b6cd1b496c8846'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.718858 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393dccd25cd34168b4b6cd1b496c8846'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.799702 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393dccd25cd34168b4b6cd1b496c8846'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.818619 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1442/2924] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:54 2022] DELETE /identity/v3/users/393dccd25cd34168b4b6cd1b496c8846 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:55.115730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:55.127187 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff261bee-5f65-45cd-8193-f4d9d59b584d service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:55.184453 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:55.185120 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:55.185405 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:55.185712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] PATH_INFO: `/v3/projects/48de441dc89747349096ca2488a521e8` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:55.186809 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48de441dc89747349096ca2488a521e8)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:55.188730 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:55.320637 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48de441dc89747349096ca2488a521e8', 'request_id': 'req-ffd5a788-d1ef-45e9-a771-ee104750d5c1'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.411712 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48de441dc89747349096ca2488a521e8', 'request_id': 'req-ffd5a788-d1ef-45e9-a771-ee104750d5c1'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.419423 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48de441dc89747349096ca2488a521e8', 'request_id': 'req-ffd5a788-d1ef-45e9-a771-ee104750d5c1'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.429801 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] The token cache is being invalidate because project 48de441dc89747349096ca2488a521e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:55.430104 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.430804 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.432305 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1483/2925] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:55 2022] DELETE /identity/v3/projects/48de441dc89747349096ca2488a521e8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:55.436332 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:55.437833 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:55.451162 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61fe3a-24c6-4619-aa27-3b04377b686c admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:55.510950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:55.511606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:55.511898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:55.512181 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] PATH_INFO: `/v3/users/c389a04c17ce45c0ac16a8c40f7e3392` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:55.513433 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c389a04c17ce45c0ac16a8c40f7e3392)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:55.515436 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:55.541341 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:55.745399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c389a04c17ce45c0ac16a8c40f7e3392'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.752027 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c389a04c17ce45c0ac16a8c40f7e3392'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.752685 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c389a04c17ce45c0ac16a8c40f7e3392'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.753305 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c389a04c17ce45c0ac16a8c40f7e3392'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.834234 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-f65f03fa-339f-4d12-8ed1-1324d9639129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c389a04c17ce45c0ac16a8c40f7e3392'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:55.853844 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1443/2926] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:55 2022] DELETE /identity/v3/users/c389a04c17ce45c0ac16a8c40f7e3392 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:56.091495 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.092991 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:56.107698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5a788-d1ef-45e9-a771-ee104750d5c1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.166221 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.166954 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.167179 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.167460 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] PATH_INFO: `/v3/projects/efb20de4ba8d4fccb8c73332933d849f` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.168599 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb20de4ba8d4fccb8c73332933d849f)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.170610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.291353 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:56.302862 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb20de4ba8d4fccb8c73332933d849f', 'request_id': 'req-7c618221-7a65-42cb-a74e-d64bd9afcf0d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.375030 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb20de4ba8d4fccb8c73332933d849f', 'request_id': 'req-7c618221-7a65-42cb-a74e-d64bd9afcf0d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.381493 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb20de4ba8d4fccb8c73332933d849f', 'request_id': 'req-7c618221-7a65-42cb-a74e-d64bd9afcf0d'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.393581 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] The token cache is being invalidate because project efb20de4ba8d4fccb8c73332933d849f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:56.393902 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.394544 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-7c618221-7a65-42cb-a74e-d64bd9afcf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.396076 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1484/2927] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:56 2022] DELETE /identity/v3/projects/efb20de4ba8d4fccb8c73332933d849f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:56.401172 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.401462 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.401736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.421635 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:56.423126 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:56.486819 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1444/2928] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:56.495403 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.495695 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.495979 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.515989 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:56.517297 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:56.525702 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1485/2929] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:56.530133 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.539747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d334b2-72ec-48ad-8cf8-cde2acac0b63 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.545327 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.545931 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.546214 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.546492 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] PATH_INFO: `/v3/domains` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.547138 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=89119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:56.547446 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.549053 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.561431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1445/2930] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:56.565625 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.574847 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a421f-f783-4003-aebe-00dc15f973ae None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.579560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.580147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.580426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.580698 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.581358 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.583238 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.742658 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1486/2931] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:56 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:56.747556 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.757886 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6ce7-d457-4953-b1e7-d9170f4a7258 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.814985 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.815592 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.815873 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.816148 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.816783 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.818747 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.948852 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1446/2932] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:56 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:56.953129 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.964388 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c29fc7-8f70-4d79-8728-81e15e920af2 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.969338 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.974849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.974849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.974849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.974849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.974849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.983437 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1487/2933] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:56.987381 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.997849 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863dcb-55e3-4d8b-b0ba-e0633ce5c017 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.002431 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07620602-7e31-4e27-bcb2-cd92fe04fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.003033 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07620602-7e31-4e27-bcb2-cd92fe04fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.003322 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07620602-7e31-4e27-bcb2-cd92fe04fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.003603 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07620602-7e31-4e27-bcb2-cd92fe04fe61 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.004248 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07620602-7e31-4e27-bcb2-cd92fe04fe61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.005887 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07620602-7e31-4e27-bcb2-cd92fe04fe61 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.016485 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1447/2934] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:57.020561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.030832 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee188100-03b7-430b-b42c-17e6a73e9a6c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.035315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.035951 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.036232 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.036507 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] PATH_INFO: `/v3/projects/5ae4ba4c74d14623b27b6a050493e422/users/e109caa2dcef483f8c0613f43274f781/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.051145 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae4ba4c74d14623b27b6a050493e422, user_id=e109caa2dcef483f8c0613f43274f781, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.053813 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.135569 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1488/2935] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:57 2022] PUT /identity/v3/projects/5ae4ba4c74d14623b27b6a050493e422/users/e109caa2dcef483f8c0613f43274f781/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:57.145649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.145941 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.146226 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.155978 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:57.175971 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] MFA Rules not processed for user `e109caa2dcef483f8c0613f43274f781`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:57.177223 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:57.241654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1448/2936] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:57.246418 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.308038 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87afca8-f071-4394-b3c5-202729e4aa7c admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.312645 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.313281 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.313566 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.313844 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.314468 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.316367 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.413351 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1489/2937] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:57.417609 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.428898 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611b39-c7be-43ef-b9f3-4bdb8f56edd9 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.485723 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.486336 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.486625 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.486909 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.487554 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.489553 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.600652 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1449/2938] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:57.604513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.615141 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f70644-4d85-4e9c-b127-8218f7517c9b admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.620632 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.621505 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.621789 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.622112 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.622883 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.624531 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.636697 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1490/2939] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:57.640766 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.651083 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec36bb0-e595-4822-9839-65e0487a5ae8 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.655807 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c72c-53ea-4deb-a5d7-cbdfefc1e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.656406 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c72c-53ea-4deb-a5d7-cbdfefc1e203 admin admin] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.656694 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c72c-53ea-4deb-a5d7-cbdfefc1e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.657008 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c72c-53ea-4deb-a5d7-cbdfefc1e203 admin admin] PATH_INFO: `/v3/roles` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.657687 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c72c-53ea-4deb-a5d7-cbdfefc1e203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.659271 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c72c-53ea-4deb-a5d7-cbdfefc1e203 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.669647 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1450/2940] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:57.674065 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.684873 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b26ff-bc09-4ff5-8d35-201d0d03f352 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.689787 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.699407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] REQUEST_METHOD: `PUT` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.699407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.699407 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] PATH_INFO: `/v3/projects/3dbe8197325f40e79f35f725b87c3787/users/41bcd328ec894fdf8d74f9c2ed467c25/roles/9b4d98f235024d4a90a0daee2b22a5e1` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.706533 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbe8197325f40e79f35f725b87c3787, user_id=41bcd328ec894fdf8d74f9c2ed467c25, role_id=9b4d98f235024d4a90a0daee2b22a5e1)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.709190 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.800703 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1491/2941] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:57 2022] PUT /identity/v3/projects/3dbe8197325f40e79f35f725b87c3787/users/41bcd328ec894fdf8d74f9c2ed467c25/roles/9b4d98f235024d4a90a0daee2b22a5e1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:57.814470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.814762 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.815047 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.843808 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] MFA Rules not processed for user `41bcd328ec894fdf8d74f9c2ed467c25`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:57.845066 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:57.910649 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1451/2942] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:57.915168 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.924463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:57.978561 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201801a5-d14c-47a1-8041-adb9453b28cf admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.983315 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.983921 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.984208 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.984487 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] PATH_INFO: `/v3/projects` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.985164 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.987227 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.075853 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1492/2943] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:31:58.079993 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.086904 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:58.094534 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568295e1-0272-4cc7-b02a-4ecfb5b8fb81 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.153847 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.154463 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.154749 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.155028 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] PATH_INFO: `/v3/users` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.155664 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.157653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.239867 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1452/2944] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:58 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:58.244611 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.254899 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fcfa-b5b4-452e-bd33-c1b37176d867 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.259860 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.262316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.262316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.262316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.262316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.263323 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.274006 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1493/2945] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:31:58.278185 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.288197 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b17bde-e2d6-484d-9833-bd0093aa5c35 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.293303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.293945 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.294224 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.294498 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] PATH_INFO: `/v3/projects/e23dc0ea971f4157a71f4d8b55cf2378/users/94642c4f7d4a494d86adab7371689d9e/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.311045 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23dc0ea971f4157a71f4d8b55cf2378, user_id=94642c4f7d4a494d86adab7371689d9e, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.313771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.392419 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1453/2946] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:58 2022] PUT /identity/v3/projects/e23dc0ea971f4157a71f4d8b55cf2378/users/94642c4f7d4a494d86adab7371689d9e/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:58.396514 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.408147 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a78684-12f6-40ab-a259-0086d8fd74e1 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.471285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016bc40-9475-410e-a50d-78170ad6c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.471895 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016bc40-9475-410e-a50d-78170ad6c9ca admin admin] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.472181 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016bc40-9475-410e-a50d-78170ad6c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.472463 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016bc40-9475-410e-a50d-78170ad6c9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.473136 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016bc40-9475-410e-a50d-78170ad6c9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.474747 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016bc40-9475-410e-a50d-78170ad6c9ca admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.485192 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1494/2947] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:58.489429 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.499690 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6176-ce3f-49bf-b516-277ae935cbe4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.504353 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.505034 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.505320 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.505602 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] PATH_INFO: `/v3/projects/e23dc0ea971f4157a71f4d8b55cf2378/users/94642c4f7d4a494d86adab7371689d9e/roles/c6c86d08ed6c422ea1eecadea6d8eb34` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.510469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23dc0ea971f4157a71f4d8b55cf2378, user_id=94642c4f7d4a494d86adab7371689d9e, role_id=c6c86d08ed6c422ea1eecadea6d8eb34)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.510469 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.521182 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1454/2948] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:58 2022] PUT /identity/v3/projects/e23dc0ea971f4157a71f4d8b55cf2378/users/94642c4f7d4a494d86adab7371689d9e/roles/c6c86d08ed6c422ea1eecadea6d8eb34 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:31:58.531894 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] REQUEST_METHOD: `POST` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.532189 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.532475 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.560606 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.auth.core [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] MFA Rules not processed for user `94642c4f7d4a494d86adab7371689d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=89118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:58.561849 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:58.628913 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1495/2949] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:58.647606 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.651291 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:58.709265 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92b8cc-20dc-49da-bfbc-536f165700f4 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.714494 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.715102 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.715387 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.715661 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.773838 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.775935 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.784653 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1455/2950] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:00.772734 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:00.774207 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:00.781156 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:00.786640 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078835c9-9394-4b0e-a55e-67b69c70ff04 None None] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:00.790253 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:00.790938 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:00.791306 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:00.791596 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:00.849546 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:00.850997 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:00.860100 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1496/2951] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:02.477409 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:02.486757 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f61bd-1419-483d-8d52-6b316398344d service cinder] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:02.490385 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36761163-1642-4d8d-b3b0-b6dc6c91d06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37d12b58ffac40e8a90d32748f470a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:02.490986 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761163-1642-4d8d-b3b0-b6dc6c91d06c service cinder] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:02.491380 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761163-1642-4d8d-b3b0-b6dc6c91d06c service cinder] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:02.491549 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36761163-1642-4d8d-b3b0-b6dc6c91d06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:02.499056 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:02.501486 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36761163-1642-4d8d-b3b0-b6dc6c91d06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:02.503041 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36761163-1642-4d8d-b3b0-b6dc6c91d06c service cinder] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:02.512927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1456/2952] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:07.325370 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:07.429753 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e2415-2e6a-4497-9d14-b4fe1d8cc945 service cinder] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:07.434410 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:07.435062 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:07.435330 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:07.435612 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] PATH_INFO: `/v3/users/e109caa2dcef483f8c0613f43274f781` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:07.436755 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e109caa2dcef483f8c0613f43274f781)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:07.438882 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:07.647451 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e109caa2dcef483f8c0613f43274f781'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:07.648111 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e109caa2dcef483f8c0613f43274f781'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:07.655110 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e109caa2dcef483f8c0613f43274f781'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:07.659404 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:07.714099 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e109caa2dcef483f8c0613f43274f781'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:07.727430 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e109caa2dcef483f8c0613f43274f781'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:07.733316 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1497/2953] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:07 2022] DELETE /identity/v3/users/e109caa2dcef483f8c0613f43274f781 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:07.737925 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] REQUEST_METHOD: `POST` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:07.738411 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:07.738859 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:07.789233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.auth.core [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] MFA Rules not processed for user `eb6feed3b7e84d328882d1d64e2f0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=89119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:07.790435 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:07.853067 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1457/2954] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 30 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:32:07.863024 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:07.864508 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:07.938513 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048606-62ac-4832-ba5c-7863a8a13ceb admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:07.942040 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a39e19ba8648ceb28c67d22c00e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:07.942642 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:07.942922 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:07.943197 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:07.952113 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:07.954233 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:07.963535 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1498/2955] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:08.407163 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:08.408667 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:08.420726 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04b21-86a9-4557-94e7-ad82a547ed04 None None] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:08.426654 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:08.427399 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:08.427781 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:08.427999 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] PATH_INFO: `/v3/projects/5ae4ba4c74d14623b27b6a050493e422` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:08.429140 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae4ba4c74d14623b27b6a050493e422)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:08.431075 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:08.532165 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae4ba4c74d14623b27b6a050493e422', 'request_id': 'req-0a3416a2-41eb-4c5f-89b3-3bed920111b0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.538391 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae4ba4c74d14623b27b6a050493e422', 'request_id': 'req-0a3416a2-41eb-4c5f-89b3-3bed920111b0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.543924 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae4ba4c74d14623b27b6a050493e422', 'request_id': 'req-0a3416a2-41eb-4c5f-89b3-3bed920111b0'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.633483 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] The token cache is being invalidate because project 5ae4ba4c74d14623b27b6a050493e422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:32:08.633789 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.634454 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.636044 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1458/2956] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:08 2022] DELETE /identity/v3/projects/5ae4ba4c74d14623b27b6a050493e422 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:08.640303 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:08.650167 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb298-9bcb-4b34-80ac-df80ea9a2127 service neutron] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:08.706328 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:08.706960 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:08.707275 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:08.707547 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] PATH_INFO: `/v3/users/41bcd328ec894fdf8d74f9c2ed467c25` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:08.708664 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bcd328ec894fdf8d74f9c2ed467c25)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:08.710616 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:08.879220 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bcd328ec894fdf8d74f9c2ed467c25'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.879900 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bcd328ec894fdf8d74f9c2ed467c25'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.886798 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bcd328ec894fdf8d74f9c2ed467c25'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.957819 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bcd328ec894fdf8d74f9c2ed467c25'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.962610 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:08.972201 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bcd328ec894fdf8d74f9c2ed467c25'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:08.978258 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1499/2957] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:08 2022] DELETE /identity/v3/users/41bcd328ec894fdf8d74f9c2ed467c25 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:09.399840 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:09.401364 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:09.416927 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3416a2-41eb-4c5f-89b3-3bed920111b0 admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:09.470328 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:09.478987 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:09.479627 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.479914 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.481950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] PATH_INFO: `/v3/projects/3dbe8197325f40e79f35f725b87c3787` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.481950 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbe8197325f40e79f35f725b87c3787)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:09.483303 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:09.603470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbe8197325f40e79f35f725b87c3787', 'request_id': 'req-322795d7-8d1c-4c96-badc-02409551e0ad'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:09.609780 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbe8197325f40e79f35f725b87c3787', 'request_id': 'req-322795d7-8d1c-4c96-badc-02409551e0ad'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:09.615233 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbe8197325f40e79f35f725b87c3787', 'request_id': 'req-322795d7-8d1c-4c96-badc-02409551e0ad'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:09.682401 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] The token cache is being invalidate because project 3dbe8197325f40e79f35f725b87c3787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:32:09.682693 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:09.683302 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:09.684771 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1459/2958] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:09 2022] DELETE /identity/v3/projects/3dbe8197325f40e79f35f725b87c3787 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:09.689560 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:09.693881 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:09.704465 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5df3f5-83c3-4fd8-a737-68e550e0e534 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:09.760341 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:09.760995 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.761285 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.761562 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] PATH_INFO: `/v3/users/94642c4f7d4a494d86adab7371689d9e` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.762679 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94642c4f7d4a494d86adab7371689d9e)` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:09.764603 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:10.049165 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94642c4f7d4a494d86adab7371689d9e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.049855 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94642c4f7d4a494d86adab7371689d9e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.056848 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94642c4f7d4a494d86adab7371689d9e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.176917 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94642c4f7d4a494d86adab7371689d9e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.189215 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.notifications [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94642c4f7d4a494d86adab7371689d9e'} {{(pid=89118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.195496 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1500/2959] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:09 2022] DELETE /identity/v3/users/94642c4f7d4a494d86adab7371689d9e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:10.656487 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:10.657949 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:10.673684 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322795d7-8d1c-4c96-badc-02409551e0ad admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:10.734286 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb6feed3b7e84d328882d1d64e2f0e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7dff46aac1450a9c4f3cfcc96d1d48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:10.738191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] REQUEST_METHOD: `DELETE` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:10.738191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:10.738191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] PATH_INFO: `/v3/projects/e23dc0ea971f4157a71f4d8b55cf2378` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:10.738191 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23dc0ea971f4157a71f4d8b55cf2378)` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:10.739544 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:10.872278 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23dc0ea971f4157a71f4d8b55cf2378', 'request_id': 'req-319ae04f-1ab2-4e68-8fdf-17735c46482a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.879212 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23dc0ea971f4157a71f4d8b55cf2378', 'request_id': 'req-319ae04f-1ab2-4e68-8fdf-17735c46482a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.884824 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23dc0ea971f4157a71f4d8b55cf2378', 'request_id': 'req-319ae04f-1ab2-4e68-8fdf-17735c46482a'} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.987623 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] The token cache is being invalidate because project e23dc0ea971f4157a71f4d8b55cf2378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=89119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:32:10.987842 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.988510 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.notifications [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=89119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:10.990087 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1460/2960] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:10 2022] DELETE /identity/v3/projects/e23dc0ea971f4157a71f4d8b55cf2378 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:32:20.191914 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:DELETE=12,keystone:SELECT=58,keystone:INSERT=1 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:20.984251 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:22.074060 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Authenticating user token {{(pid=89118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:22.075471 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:22.167721 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22b819-6a7b-46e4-8efb-1e9d7bd1fd86 admin admin] Validating token access rules against request {{(pid=89118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:22.229155 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:22.229829 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] REQUEST_METHOD: `GET` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:22.230114 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] SCRIPT_NAME: `/identity` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:22.230393 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:22.232176 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.fernet_utils [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:22.244969 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:22.246582 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea1522-ffb3-458f-8d29-6bf6efb94513 service placement] RBAC: Authorization granted {{(pid=89118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:22.256426 dv-cinder-815146-13-smb devstack@keystone.service[89118]: [pid: 89118|app: 0|req: 1501/2961] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:32.252240 dv-cinder-815146-13-smb devstack@keystone.service[89118]: DEBUG dbcounter [-] [89118] Writing DB stats keystone:SELECT=67 {{(pid=89118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:26.061262 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Authenticating user token {{(pid=89119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:26.062736 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.fernet_utils [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=89119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:26.078207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ae04f-1ab2-4e68-8fdf-17735c46482a admin admin] Validating token access rules against request {{(pid=89119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:26.083207 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42780-9a6b-49af-bfc7-ae5765547997 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7eb699757f93461d8a1c29611d1204e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acea582245fc4509bd1a495c97375d6d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:26.083827 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42780-9a6b-49af-bfc7-ae5765547997 service placement] REQUEST_METHOD: `GET` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:26.084107 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42780-9a6b-49af-bfc7-ae5765547997 service placement] SCRIPT_NAME: `/identity` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:26.084382 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42780-9a6b-49af-bfc7-ae5765547997 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=89119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:26.094470 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a42780-9a6b-49af-bfc7-ae5765547997 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:26.096108 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a42780-9a6b-49af-bfc7-ae5765547997 service placement] RBAC: Authorization granted {{(pid=89119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:26.106309 dv-cinder-815146-13-smb devstack@keystone.service[89119]: [pid: 89119|app: 0|req: 1461/2962] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 30 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:37:36.101984 dv-cinder-815146-13-smb devstack@keystone.service[89119]: DEBUG dbcounter [-] [89119] Writing DB stats keystone:SELECT=6 {{(pid=89119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}